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This thematic report explores results of the 2003 cvcle of the Programme for International 
Student Assessment (PISA) in order to identify teaching and learning strategies that contribute 
to increased achievement, particularly in mathematics. The analysis helps to clarify an under- 
standing of the following: (i) the differences between teaching and learning practices across 
countries that can allow countries to benchmark practices; (ii) the extent to which teaching 
and learning practices vary among schools in each country; and (Hi) the extent to which indi- 
vidual aspects of teaching and learning strategies are associated with better performance in 
mathematics. 

Teaching strategies range from the wavs in which classrooms and resources are organised 
and used to the wavs in which teachers and students engage in dav-to-day activities in order 
to facilitate learning. Student learning strategies include the cognitive and meta-cognitive 
processes employed bv students attempting to learn something new. PISA measures these 
strategies using a variety of questionnaire items, which can be combined and scaled to yield 
a number of composite or index variables representing broad constructs. Examples of the 
constructs examined here are disciplinary climate, teacher-student relations, memorisation 
strategies and time spent on various learning activities. 

After presenting the theoretical framework, the report follows a two -stage analytical 
approach. It first offers an analytical description of mathematics teaching and learning in dif- 
ferent countries and identifies similarities and differences between countries. In the second 
stage, the report presents findings generated from a multilevel, prediction model of the factors 
influencing mathematical achievement. After controlling for other factors, this model shows 
the “unique” effects of a particular factor on achievement. The results presented in this report 
are niainlv based on separate analyses for each country. The within-countrv results are then 
combined to allow for comparisons across a range of countries. 

The report offers useful information and analyses to education policy makers and academic 
researchers concerned with mathematics teaching and learning strategies. Further analysis 
of the effects of these strategies on student learning, particularly in reading and science, are 
used and will be possible to use in later PISA surveys. This report also offers suggestions on 
how to improve data collection and measurement of teaching and learning strategies in large 
international cross-sectional surveys such as PISA. 

This report is the product of a collaborative effort between the countries participating in 
PISA, the experts and institutions working within the framework of the PISA Consortium, 
the OECD, and Edudata Canada at the University of British Columbia. Robert Crocker, 
professor emeritus at Memorial University of Newfoundland, the principal author, drafted 
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Executive Summ^i^y 


MAIN MESSAGES 

Teaching and learning practices vary widely across educational systems and across schools within systems. 

Teaching and learning strategies are an important area of educational policy and practice. An 
international perspective on these issues informs students, parents, teachers, policy makers and 
other stakeholders about the most common patterns in their system, how these compare to other 
countries, and how these practices vary across schools within these systems. When examining these 
issues, it is important to inform students, parents, teachers, policy makers and other stakeholders 
about the most common patterns in their systems and how teaching and learning practices vary 
from school to school within these systems. An international perspective can also add important 
insight on how countries’ education systems compare to one another. This report offers that kind 
of insight particularly for the countries involved in the PISA 2003 cycle. The analysis of how teach- 
ing and learning practices are linked to student performance is, however, more limited, given the 
international cross-sectional nature of surveys, such as PISA, and the need for very fine and detailed 
data for the analysis of these issues. 

Teaching and learning strategies are complex processes that interact with one another, su^^estin^ that 
in-depth, context-spec^ic analyses are necessary tojhlly understand each strategy’s role in enhancing student 
pe^ormance. 

With a few interesting exceptions, most teaching and learning strategies do not have a direct, robust 
and consistent relationship with student performance across countries. The relationship between 
the strategies and performance tends to be moderated bv other factors such as student attitudes and 
background, suggesting that these issues cannot be analysed separately. 

Disciplinary climate is the main teaching-related variable that shows a robust and consistent association 
with better perjormance, both at the individual and school levels. 

Across most countries, a strong disciplinary climate is consistently and robustly associated with 
better performance. The analysis shows that bevond the individual level, policies targeted to 
improve the disciplinary climate at the school level also yield positive effects. Determining how to 
address schools and individuals facing a challenging disciplinary climate should therefore be a prior- 
ity for further in-depth, policy oriented studies. 

Student background continues to be amon^ the main determinants performance, even ajter adjusting Jor 
teaching and learning strategies, which su^^ests that these processes only play a limited moderating role 
Jor disadvantaged students. 

A combined analysis of teaching and learning strategies with student background and other anteced- 
ents shows that different practices, even if they vary a lot, do not significantly moderate the effect 
of socio-economic background. There is little evidence that teaching and learning strategies plav a 
significant role in reducing the effect of socio-economic background on student performance. 
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Student attitudes, such as cor^idence with or anxietj toivards mathematics, plaj a mediating role with 
respect to some teaching and learning strategies, and maintain their strong association with student 
perjormance even cifter adjusting Jor these strategies. 

The relationship between student performance and many of the teaching and learning strategies, in 
particular, meta-cognitive strategies, is mediated bv student attitudes. A potential area of further 
research, these mediating effects may explain the lack of eyidence for a direct relationship between 
performance and these strategies, in particular, meta-cognitiye strategies or student preferences 
for a cooperatiye or a coinpetitiye enyironinent. It is, howeyer, hard to eyaluate how much of this 
research can be accomplished with international, cross-sectional studies such as PISA. 

OVERVIEW OF THE REPORT'S APPROACH 

This thematic report presents new eyidence on teaching and learning strategies for mathematics 
that emerges from the PISA 2003 assessment and complements the results discussed in other PISA 
reports {e.g. OECD, 2004, 2005). The report’s analysis clarifies understanding of the following: 
the differences across countries between teaching and learning practices, which allow countries 
to benchmark practices; the extent to which teaching and learning practices yary from school to 
school within each country; and the extent to which indiyidual aspects of teaching and learning are 
associated with better or worse performance in mathematics. 

The report will be useful for education policy makers and other stakeholders and concerned with 
the study of teaching and learning. It will also proye insightful for academic researchers wanting to 
identify research questions for follow-up studies. This report may thus help stimulate a new round 
of research designed to gather more detailed information on teaching and learning strategies. 
Recent examples include the OECD Teaching and Learning International Suryey (TALIS) (OECD, 
2009), which takes a large step in this direction, as well as the upcoming PISA 2012, which will 
again focus on mathematics and be another opportunity to build on the methodology and results 
presented in this report. In addition, this report may be of interest to teacher educators and officials 
within national and local educational authorities who are responsible for the professional deyelop- 
ment of teachers, programmes, and school boards and parent adyisory bodies. 

The report first suryeys the theory and measurement of teaching and learning strategies. Teaching 
strategies refer to a broad range of processes, from the way in which classrooms are organised and 
resources are used to the daily actiyities engaged in by teachers and students to facilitate learning. 
Student learning strategies refer to cognitiye and meta-cognitiye processes employed by students 
as they attempt to learn new topics. In PISA, teaching and learning strategies are measured using 
a yariety of questionnaire items, which in turn are combined and scaled to yield a number of 
composite or index yariables representing broad constructs. Examples of these constructs include 
disciplinary climate, teacher-student relations, memorisation strategies and time spent on yarious 
learning actiyities. In PISA 2003 these measures were specifically geared towards the learning of 
mathematics. The TALIS suryey extends the analysis of these strategies, their relationship to each 
other and their links to teacher beliefs. Further analysis on the effects of these strategies on student 
learning, particularly in reading and science, will be possible in later PISA suryeys. 

Most of the results presented in this report are based on separate analyses for each country. The 
within-country results are then combined to allow for comparisons across a range of countries. The 
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report follows a two-stage analytical approach. The first stage involves a comparative analysis of 
mathematics teaching and learning in order to describe how mathematics is taught in different coun- 
tries. The report then examines variations across schools within countries and, on the basis of these 
analyses, presents a broad profile of commonalities and differences in mathematics teaching and 
learning strategies. While limited in their ability to provide explanations for differences in teaching 
methodology, the results can inform policy makers in individual countries how their situation might 
relate to or differ from that of other countries in terms of consistency or variety among schools. 

The second stage of tlie analysis utilises a comprehensive two-level, student and school, prediction model 
of the factors influencing mathematics achievement. Here the primary emphasis is on the teaching and 
learning strategy variables. The analysis adjusts for a number of antecedents, which are introduced into 
in stages before entering the teaching and learning variables. This approach allows the predictive power 
of the model to be determined as groups of variables are inserted. The basis of the final reporting of the 
effects of each of the main variables is the full model. This approach offers a more complete picture of 
the real world of teaching and learning, compared to that provided bv the intermediate models, and mav 
be of more interest from a policy perspective. The report then examines mediating effects, in part bv 
the use of bivariate analysis, to compare effects using the full model versus each variable independently. 

ORGANISATION OF THIS REPORT 

Chapter 2 depicts a complex and widely varying picture of mathematics instruction, both within 
and across participating countries. It examines the characteristics of students, schools and countries 
in terms of various teaching and learning strategies, as well as the distribution of these character- 
istics. The chapter notes observed associations between various aspects of teaching and learning 
strategies and mathematics performance, as well as the extent to which these associations correlate 
with higher student achievement. 

Chapter 3 examines how selected features of teaching and learning affect performance in mathematics after 
other characteristics of students and schools are taken into account. Tlie features measured cover the ante- 
cedents to learning, the effects of teaching and learning, and teaching strategies. The analysis divides the 
total variation in students’ performance in mathematics into “between-student” and “between-school” com- 
ponents. The chapter presents results for each country separately. In addition to examining tlie observed 
association between various factors and performance, and the unique effects of these factors once other 
factors have been accounted for, tlie chapter discusses the interactions between the different measures. 

Chapter 4 summarises the report’s main results, identifies relevant educational policy and prac- 
tice issues, and examines the extent to which the available results respond to these issues. The 
chapter also considers the design of PISA in light of the interpretation issues encountered in this 
study. It seems that the use of teaching and learning strategies does not significantly mitigate the 
disadvantaged social backgrounds of some students. PISA shows that teaching and learning factors 
are related to mathematics achievement, but this relationship is not necessarily bi-directional or of 
similar magnitude across all the countries and economies studied. Country differences stand out 
for manv of these variables, a finding which suggests that effects mav be best interpreted within 
countries or clusters of countries with similar cultural backgrounds or school systems. 

Chapter 5 concludes this report and summarises the main policy insights that can be drawn from 
the evidence presented in the previous chapters. 
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Reader's Guide 

ABBREVIATIONS USED IN THIS REPORT 
Organisations 

The following abbreviations are used in this report: 

ACER Australian Council For Educational Research 

OECD Organisation for Economic Co-operation and Development 

PISA Programme for International Student Assessment 

TCMA Test-Curriculum Match Analvsis 

TIMSS Trends in Mathematics and Science Study 

Country codes 


OECD Countries 

CODE 

COUNTRY 

CODE 

COUNTRY 

AUS 

Australia 

MEX 

Mexico 

AUT 

Austria 

NLD 

Netherlands 

BEL 

Belgium 

NZL 

New Zealand 

CAN 

Canada 

NOR 

Norway 

CZE 

Czech Republic 

POL 

Poland 

DNK 

Denmark 

PRT 

Portugal 

FIN 

Finland 

KOR 

Korea 

FRA 

France 

SVK 

Slovak Republic 

DEU 

Germany 

ESP 

Spain 

GRC 

Greece 

SWE 

Sweden 

HUN 

Hungarv 

CHE 

Switzerland 

ISL 

Iceland 

TUR 

Turkev 

IRL 

Ireland 

GBR 

United Kingdom (England, Wales 

ITA 

Italy 


and Northern Ireland) 

JPN 

Japan 

SCO 

Scotland 

LUX 

Luxembourg 

USA 

United States 

OECD Partner Countries and Economies 

CODE 

COUNTRY 

CODE 

COUNTRY 

BRA 

Brazil 

PER 

Peru 

HKG 

Hong Kong-China 

RUS 

Russian Federation 

IDN 

Indonesia 

YUG 

Serbia 

LVA 

Latvia 

THA 

Thailand 

LIE 

Liechtenstein' 

TUN 

Tunisia 

MAC 

Macao-China 

URY 

Uruguay 


1 . Liechtenstein’s results are not included in results requiring a separate national scaling of 
item values as the sample size in the country was too small to provide an accurate result. 


Mathematics Teaching and Learning Strategi 


PISA ©OECD 2010 


15 


Regdei-'s Gui4e 



aping sgapea-y 


TECHNICAL DEFINITIONS 

Item docility — Historically, item difficulty is the proportion of those taking an item, or test, which 
get the item correct. Within situations employing item response theory (IRT) modelling of response 
to items relatiye to the underlying trait (e.g. mathematical literacy in the area being measured), item 
difficulty is the yalue on the trait scale where the slope of the item’s corresponding item response 
function reaches its maximal yalue. 

Fifteenyear-olds — The use of fifteen-year-olds in the discussion of the PISA sample population refers 
to students who were aged between 15 years and 3 (complete) months and 16 years and 2 (complete) 
months at the beginning of the assessment period and who were enrolled in an educational institu- 
tions regardless of grade leyel or institution type or if they were enrolled as a full-time or part-time 
students. 

OECD average — Takes the OECD countries as single entities, each with equal weight. Hence, an 
OECD ayerage is a statistic generated by adding the country ayerages and diyiding by the number 
of OECD countries inyolyed. The OECD ayerage proyides data on how countries rank relatiye to 
the set of countries within the OECD. 

OECD total — Takes the OECD countries merged as a single entity to which each country contrib- 
utes in proportion to the number of its students in the appropriate population. The computation 
of the OECD total inyolves the sum total of the outcome yariable of interest diyided by the total 
number of data-related students within the OECD countries. The OECD total proyides a compari- 
son statistic for the total human capital present with the OECD countries. 

Rounding of numbers — Because of rounding, some columns or groups of numbers may not add up to 
the totals shown. Totals, differences, and ayerages are always calculated on the basis of exact num- 
bers and then rounded after calculation. 

SYMBOLS FOR MISSING DATA 

Six symbols are employed in the tables and charts to denote missing data: 
a Data is not applicable because the category does not apply. 

c There are too few obseryations to proyide reliable estimates (i.e. there are fewer than 3% of 
students for this cell or too few schools for yalid inferences). Howeyer, these statistics were 
included in the calculation of cross-country ayerages. 
m Data is not ayailable. 
n Magnitude is either negligible or zero. 

S.E. Standard error. 

w Data has been withdrawn at the request of the country concerned. 

X Data included in another category or column of the table (e.g. x(2) means that data are included 
in column 2 of the table). 

FURTHER DOCUMENTATION 

For further documentation on the PISA assessment instruments and the methods used in PISA, see 
the PISA 2003 Technical Report (OECD, 2005), the Australian Council of Educational Research 
PISA site (wwiv.acer.edu.au/ozpisa) and the PISA web site (wivw.pisa.oecd.orf. 
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This chapter provides an overview and rationalejor this report, situating the studj in the 
context of PISA research endeavours for both the past and the future. It describes early 
research on teaching and learning strategies and lays out the theoretical framework, key 
index and control variables which are derived for the examination of teaching and learning 
strategies and associated with higher mathematics peformance. 
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OVERVIEW OF PISA 

The Organisation for Economic Co-operation and Development s (OECD) Programme for International 
Student Assessment (PISA) began in 1997. Developed jointlv bv OECD member countries through 
the OECD’s Directorate for Education, PISA measures the extent to which students are acquiring 
some of the knowledge and skills that are essential for full participation in today’s knowledge societv. 
PISA has an important role in the work of the OECD’s Directorate for Education, which collects data 
and provides comparative indicators of education svstems in OECD member and partner countries. 
PISA helps to highlight those countries which achieve both high performance and an equitable distri- 
bution of learning opportunities, and in doing so sets ambitious goals for other countries. 

PISA’s global span, regularitv and test population are unique. More than 70 countries have taken 
part in one or more PISA survevs so far (see Figure 1.1). Beginning in 2000, these survevs have 
taken place at three-year intervals. The 2000 survev covered 32 countries and had reading as its 
major focus, with minor assessments in mathematics and science. The 2003 survev was carried out 
in 41 countries and had mathematics as its major focus, with minor assessments in reading, science 
and problem solving. The 2006 survev took place in 58 countries and focused on science, with 
minor assessments in reading and mathematics. All PISA survevs assess 15-vear-old students, an age 
at which voung adults are nearing the end of compulsorv schooling in most countries. 

In addition to the assessment instruments, PISA also includes detailed questionnaires to be completed 
bv students and school principals. These questionnaires gather a varietv of data on student back- 
grounds, behaviours and attitudes, student perceptions, teaching practices, school characteristics, 
the organisation of instruction and other factors that may be reported comparativelv and used to help 
account for differences in achievement. 


Figute 1.1 ■ A map of PISA countries and economies 
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Shanghal-China 

Macedonia 

Moldova 

Panama 

Peru 

Singapore 

Trinidad and Tobago 


Source: OECD (2007). 
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The OECD publishes the main results from each PISA survey in the year after the assessment has 
taken place. Participating countries also prepare individual country reports. In addition, the OECD 
publishes thematic reports drawing on the data from each PISA survey in order to present more 
detailed analysis of policy-relevant issues. This thematic report focuses on teaching and learning 
strategies and uses data from the PISA 2003 survey. 


AIM AND AUDIENCE OF THIS REPORT 

The analysis in this report mav help clarify understanding of: the differences between teaching 
and learning practices in different countries, thus allowing countries to benchmark practices; the 
extent to which teaching and learning practices vary from school to school within each country, 
and the extent of the association between individual aspects of teaching and learning and better or 
worse performance in mathematics. The report will be useful for policy makers and stakeholders 
who need to understand better how their systems and school compare with those in other coun- 
tries and economies who participated in PISA 2003. It mav also provide insights for the design and 
implementation of educational policies aiming at improving the quality of education for all students. 

In addition, this report mav be of interest to teacher educators and officials within national and 
local educational authorities responsible for the professional development of teachers or programme 
development, as well as members of school boards and parent advisory bodies. 

The report will also be useful to researchers concerned with the study of teaching and learning, particu- 
larly in identifying research questions that warrant follow-up through more intensive studies. Indeed, this 
report should be useful in helping to stimulate a new round of research designed to gain more detailed 
knowledge of teaching and learning strategies than is possible through large-scale survey methods. 


BACKGROUND OF THIS REPORT 

The report examines relationships among teaching strategies, student learning strategies and math- 
ematics achievement, using data from the PISA 2003 survey. Figure 1.2 describes the PISA 2003 
achievement scales in mathematics, reading and science. Because in 2003 mathematics was the focus of 
the PISA assessment and the questionnaires, this report concentrates on performance in mathematics. 

The primary aim of this report is to identify instructional practices and learning strategies, both in 
general and within mathematics, that contribute both to increased achievement and to decreased 
variation in achievement. It also examines the degree to which such strategies are universal or 
context-specific and how these strategies mav be related to the structure of school systems in dif- 
ferent countries. 

The overarching conceptual model for this report is the idea that the well-being of a modern society 
depends not onlv on capital and labour but also on the knowledge and ideas generated bv individual 
workers. In particular, theory holds that economic benefits derive from investment in people, with 
education as the primary means of development of this human capital, so that educational expendi- 
tures are considered as investments (Sweetland, 1996). How then to maximise return on investment? 

Long-term returns are beyond the scope of this report. Instead, it takes school achievement in 
mathematics as measured bv PISA 2003 as a proximate outcome. Figure 1.3 gives a summary of 
overall student performance in different countries on the PISA 2003 mathematics scale, presented 
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Figut'S 1.2 ■ Summary of the assessment areas covered in PISA 2003 







Assessment 




area 

Mathematics 

Science 

Reading 

Definition 

“The capacity to identify and under- 

“The capacity to use scientific 

“The capacity to understand, use 

and its 

stand the role that mathematics plays 

knowledge, to identify scientific 

and reflect on written texts in order 

distinctive 

in the real world, to make well- 

questions and to draw evidence- 

to achieve one’s goals, to develop 

features 

founded judgements and to use and 

based conclusions in order to under- 

one’s knowledge and potential, and 


engage with mathematics in ways that 

stand and help make decisions about 

to participate in society” (OECD, 


meet the needs of that individual’s 

the natural world and the changes 

2003e). 


life as a constructive, concerned and 

made to it through human activity” 

Much more than decoding and 


reflective citizen” (OECD, 2003e). 

(OECD, 2003e). 

literal comprehension, reading 


Related to wider, functional use of 

Requires understanding of scientific 

involves understanding and 


mathematics, engagement requires 

concepts, an ability to apply a 

reflection, and the ability to use 


the ability to recognise and formu- 
late mathematical problems in vari- 
ous situations, 

scientific perspective and to think 
scientifically about evidence. 

reading to fulfil one’s goals in life, 

“Content” 

Clusters of relevant mathematical 

Areas of scientific knowledge and 

The form of reading materials: 

dimension 

areas and concepts: 

concepts, such as; 

• “continuous” materials including 


• quantity; 

• biodiversity; 

different kinds of prose such 


• space and shape; 

• forces and movement; and 

as narration, exposition, 


• change and relationships; and 

• uncertainty. 

• physiological change. 

argumentation; and 
• “non-continuous” texts including 
graphs, forms, lists. 

“Process” 

“Competency clusters” define skills 

The ability to use scientific 

Type of reading task or process; 

dimension 

needed for mathematics; 

knowledge and understanding. 

• retrieving information; 


♦ reproduction (simple 

to acquire, interpret and act on 

* interpreting texts; and 


mathematical operations); 

evidence: 

• reflection and evaluation of texts. 


• connections (bringing together 

• describing, explaining and 

The focus of PISA is on “reading 


ideas to solve straightforward 

predicting scientific phenomena; 

to learn”, rather than “learning to 


problems); and 

• understanding scientific 

read”, and hence students are not 


♦ reflection (wider mathematical 

investigation; and 

assessed on the most basic reading 


thinking), 

In general these are associated with 
tasks of ascending difficulty, but 
there is overlap in the rating of 
tasks in each cluster. 

• interpreting scientific evidence 
and conclusions. 

skills. 

“Situation” 

Situations vary according to their 

The context of science, focusing on 

The use for which the text 

dimension 

“distance” from individuals’ lives. 

uses in relation to: 

constructed; 


In order of closeness: 

• life and health; 

• private {eg., a personal letter); 


• personal; 

• the Earth and the environment; 

• public {e.g., an official document); 


• educational and occupational; 

and 

• occupational (e.g., a report); 


• local and broader community; and 

♦ scientific. 

• technology. 

• educational (e.g., school related 
reading). 


Source: OECD (2004), Learning for Tomorrow’s World: First Kesuksfrom PISA 2003, OECD, Paris. 
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in terms of the mean student score. When interpreting mean performance, only those differences 
between countries that are statistically significant should be taken into account. Figure 1.3 therefore 
shows those pairs of countries where the difference in their mean scores is sufficient to say with 
confidence that the higher performance by sampled students in one country holds for the entire 
population of enrolled 15 -year-olds. 


Figute 1.5 ■ Multiple comparisons of mean performance on the mathematics scale 



OECD countries * 










* Becau.se data are based on sample.s, it is not possible to report exact rank order positions for countries. However, it is possible to report the range of rank order positions 
within which the countrv me. an iieswith95per cent likelihood. 


Instructions: 

Read across the row for a countrr to compare performance with 
the countries listed along the top of the chart. The symbols indicate 
whether the average performance of the countrv in the row is 
significanth' lower than that of the comparison countrx', significantly 
higher than that of the comparison countrv, or if there is no 
statistically significant difference between the axerage achievement 
of the two countrie.s. 


It’jf/iiiuf the 
Bonferi 


adjustm ent; 

With the 
Bonferroni 
aJjastm ent: 


A 


V 







.Mean performance statistically significantly higher than in comparison country. 
No stalisticallv significant difference from comparison country. 

Mean performance statisticallv significantly lower than in comparison countrv. 

Mean performance .statistically significantly higher than in comparison countrv. 
No statisticallx* significant difference from comparison countrx*. 

.Mean performance statisticallx* significantly lower than in comparison countrv. 

Statisticallx* significant lx* above the OECD average 

Not statisticallx* significantlx* dill’crent from the OECD ax'cragc 

Slalisticallx significantly below the OECD axcrage 


Source: OECD PISA 2003 database. 
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In Figure 1.3, a country’s performance relative to that of the countries listed along the top of the 
figure can be seen bv reading across each row. The colour-coding indicates whether the average 
performance of the country in the row is either lower than that of the comparison country, not 
statistically different, or higher. When making multiple comparisons, e.^. when comparing the 
performance of one country with that of all other countries, an even more cautious approach is 
required, and only those comparisons that are indicated by the upward or downward pointing 
symbols should be considered statistically significant for the purpose of multiple comparisons. 
Figure 1.3 also shows which countries perform above, at or below the OECD average. It is not pos- 
sible to determine the exact rank order position of countries in the international comparisons (see 
Box 2.1 in OECD, 2004 for details). However, Figure 1.3 shows, with 95% probability, the range 
of rank order positions within which the country mean lies, both for the group of OECD countries 
and for all countries that participated in PISA 2003. 

Mean performance scores are typically used to assess the quality of schools and education systems. 
Mean performance however does not provide a full picture of student performance and can mask 
significant variation within an individual class, school or education system. 

Achievement as measured bv PISA has an impact on access to higher education and thus ultimately 
on economic advantage and other longer-term outcomes contributing to the well-being of both the 
individual and society. Patbwajs to Success (OECD, 2010), offers an example and shows for example 
that top performing Canadian students in PISA are twenty times more likely to access university 
than those performing at the bottom. 

PISA results have shown that students’ socio-economic background is a strong predictor of achieve- 
ment (OECD, 2001; OECD, 2004; OECD, 2007). In this report, socio-economic background is 
a control variable in most of the models developed, to ensure that teaching and learning strategy 
effects are treated independently of socio-economic effects. Furthermore, the productivity model 
used may not be especially helpful in providing insights into the policies, strategies and practices 
that might allow for higher achievement and greater equity in achievement, despite the utility of 
such a model as an overarching wav of establishing the importance of high achievement. However, 
theory and research on teaching and learning can prove helpful, as discussed below. 


DEFINITION AND RELEVANCE OF TEACHING AND LEARNING STRATEGIES 

Teaching strategies refer to a broad range of processes, from the organisation of classrooms and 
resources to the moment -bv-moment activities engaged in by teachers and students to facilitate 
learning. Student learning strategies refer to cognitive and meta-cognitive processes employed bv 
students as they attempt to learn something new. PISA measures teaching and learning strategies 
using a variety of questionnaire items, which in turn are combined and scaled to yield a number 
of composite or index variables representing broad constructs. Examples of these constructs are 
disciplinary climate, teacher-student relations, memorisation strategies and time spent on various 
learning activities. Further, PISA 2003 gears these measures specifically towards the learning of 
mathematics. The recent publication of the first results from the OECD Teaching and Learning 
International Survey (see Box 1.1) adds considerably to the knowledge of differences in the uses of 
these strategies across participating countries, and affirms the importance of investigating these 
strategies. Although TALIS does not examine the relationship of these strategies to student learn- 
ing, this would be possible using data from subsequent cycles of PISA (e.^. PISA 2006 and 2009). 
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Box 1.1 ■ The OECD Teaching and Learning International Survey 

The OECD Teaching and Learning International Survey (TALIS) is the first international survey 
in which the major focus is on the learning environment and the working conditions of teachers in 
schools. TALIS offers an opportunity for teachers and school principals to provide input into educa- 
tion analysis and policy development, by means of the issues examined in the survey. Cross-country 
analysis from TALIS will allow individual countries to identify other countries facing similar chal- 
lenges and to learn from other policy approaches. The main study took place in 2007-08 and an 
initial report was published in 2009 (OECD, 2009). First results from TALIS appear below: 

Creating effective teaching and learning environments 

In most countries, the large majority of teachers are satisfied with their jobs and consider that they 
make a significant educational difference to their students. Teachers are also investing in their 
professional development, both in terms of time and often also in terms of money, an investment 
which goes hand in hand with a wider repertoire of pedagogic strategies used in the classroom. 

Better support for effective teaching is needed through teacher appraisal and feedback. The 
generally positive reception bv teachers of the appraisal and feedback which they receive on 
their work indicates a willingness in the profession to move forward in this area. 

TALIS highlights better and more targeted professional development as an important lever 
for improvement in teacher effectiveness. Relatively few teachers participate in the kinds 
of professional development which they find have the largest impact on their work, namelv 
programmes leading to a qualification, and individual and collaborative research. 

The hardest issues to resolve relate to the actual improvement of teaching practice. Teachers 
in most countries report using traditional practices aimed at transmitting knowledge in 
structured settings much more often than they use student-oriented practices, such as adapt- 
ing teaching to individual needs. 

TALIS suggests that effective school leadership plavs a vital role in teachers’ working lives 
and that it can make an important contribution to shaping the development of teachers. In 
schools where strong instructional leadership is present, TALIS shows that school principals 
are more likelv to use further professional development to address teachers’ weaknesses as 
identified in appraisals. 

The close associations that TALIS shows between factors such as a positive school climate, 
teaching beliefs, co-operation between teachers, teacher job satisfaction, professional devel- 
opment, and the adoption of a range of teaching techniques provide indications that public 
policy can actively shape the conditions for effective learning. At the same time, the fact that 
much of the variation in these relationships lies in differences among individual teachers, 
rather than among schools or countries, underlines the need for individualised and targeted 
programmes for teachers to complement the whole-school or svstem-wide interventions that 
have traditionally dominated education policy. 

Source; OECD (2009), Creating EJJective Teaching and Learning Environments: First Results from TALIS. 
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In their well-known synthesis of factors influencing achievement, Wang et al. (1993) put forward 
the concept of proximity as a way of thinking about the relative effects of various factors. The gen- 
eral hypothesis is that, proximal factors, or those which touch the dav-to-dav lives of students most 
closely, are likelv to be more influential than more distal factors, such as administrative charac- 
teristics of the education svstem at the national level. For example, classroom management, meta- 
cognitive processes, cognitive processes, home environment, parental support and student-teacher 
social interactions show stronger relationships to achievement than broad state- and district-level 
educational policies. This point is of crucial importance because it suggests that broad policy initia- 
tives are likelv to result in improved learning only if translated into change at the individual teacher 
or student level. 


Among the many factors that influence scholastic proficiency, teaching and learning strategies 
are second onlv to home circumstances in their proximity to the dav-to-dav activities of students 
and hence in their potential to influence performance directly. Teaching strategies also change 
through educational policy initiatives and through teacher education and professional development. 
Determining which teaching and learning strategies are most effective in improving overall per- 
formance and reducing disparities in performance is one of the primary functions of educational 
research and one of the most direct wavs in which policy decisions can influence learning. 

From a policv perspective, it is also useful to consider briefly how strategies proved to be success- 
ful may be implemented. It is important to distinguish those that can be put into practice through 
teacher education from professional development or other policv initiatives within the control of 
educational jurisdictions, as well as to distinguish those that can be implemented at relatively low 
risk or low cost from those with significant risks or cost implications. Policv decisions based on 
relatively weak evidence can be justified if the risks are small and the costs are low, but not under 
other circumstances. 


EARLY RESEARCH ON TEACHING AND LEARNING STRATEGIES 

Although one might expect research on teaching strategies and on learning strategies to converge, 
the two tend largely to follow separate paths. Much earlv work on teaching strategies follows a rela- 
tively simple “process-product” model, under which the primary focus is on correlations between 
classroom processes and student achievement. The archetypal studv under this model is a small- 
scale classroom observational studv which categorises and correlates various classroom processes 
with measures of achievement. During the 1970s, a number of relatively large-scale quasi-experi- 
mental field studies took this approach (e.g. Brophv and Evertson, 1974; Stallings and Kaskowitz, 
1974; Clark et al., 1979). However, research of this nature has declined in recent years. 

Dunkin and Biddle’s seminal volume The Studj of Teaching (1974) summarised much of the earlv 
research on teaching. Other major syntheses of this work appeared in the third edition of the 
Handbook of Research on Teaching (Wittrock, 1986, particularly the chapters bv Shulman, Brophv and 
Good, Rosenshine, and Stevens and Doyle). Dunkin and Biddle present a model for the studv of 
teaching that extends bevond the dominant process-product model to include what the authors call 
presage and context variables. In this model, both these categories of variables have onlv indirect 
influences on outcomes. Shulman’s Handbook chapter attempts to go bevond the process-product 
model to present a synoptic model that includes teacher and student backgrounds, curriculum 
content, classroom processes and the various contexts and agendas that impinge on teaching and 
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learning. The intellectual and social/organisational transactions which mediate teaching to produce 
learning are a major component of Shulnian’s model. This concept of mediation forms the basis for 
a broader approach that can help integrate research on teaching and learning. 

Earlv research on teaching, especially that based on the process-product model, tends to be largely 
atheoretical, consisting essentially of a search for correlates of teaching variables with achievement. 
Research on learning has traditionally had a more theoretical orientation than research on teaching, 
and has grown out of either behavioural or cognitive psychology. Earlv studies in the behavioural 
tradition tend to be concerned with memorv or conditioning, under a simple stimulus-response 
model. What goes on in the learner’s mind between the stimulus and the response is not part of the 
model. Cognitive studies varv widely and include developmental work in the Piagetian tradition, 
problem solving, and learning bv discovery, as well as meta-cognitive strategies, and other aspects 
of learning that can be identified with “active learning”. Within the constructivist framework, 
more recent workmav be considered as a logical extension of the cognitive approach. Such studies 
explore, at least implicitly, the intervening events between the stimulus and response or between 
the process and product. 

Research on teaching and learning is beginning to converge in the mediating process and construc- 
tivist approaches. From this more integrated perspective, one may argue that students construct 
knowledge through a complex process of interaction with all of the features of their environment, 
including their home, peer group and school, as well as other sources of influence. Educational 
policy aims primarily at influencing the school environment, while other influences, such as home 
circumstances, mav be mediated bv broader social or economic policies. Nevertheless, educational 
policy mav be designed to improve the effects of other environmental influences, particularly 
negative ones. Indeed, the whole concept of improving equity in educational achievement (not just 
in educational opportunities) mav be said to stem from the need to overcome adverse influences 
outside the school. 

Research on teaching and on learning is also converging to some degree in studies of the impact of 
self-concept, motivation, attention and meta-cognitive processes (strategies for learning). The work 
of Cronbach and Snow (1977) and others on aptitude-treatment interactions is an example of this 
convergence, specifically of the idea that teaching strategies can or should match learning styles. 
However, this research seems to offer little guidance on how such matches can be made under 
classroom conditions. 

The well-known time-based model originally proposed bv Carroll (1963) captures the notion that 
teaching influences learning bv incorporating into the core model the components of opportunity 
to learn, time allocated bv the teacher and quality of instruction. This model connects further 
with a broad approach to teaching and to educational policy in its extension bv Bloom (1981) to 
the concept of “mastery learning”. In an attempt to address directly the issue of equity in learn- 
ing, Bloom proposes that the time allocated to accomplish a task varv sufficiently in order to allow 
almost all students to achieve specified learning outcomes. Putting this into practice, of course, 
requires significant variation in both school organisation and teaching strategies, to an extent that 
it is difficult to find examples of large-scale implementation of mastery learning, despite its strong 
research support. 
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THE CARROLL MODEL AS A THEORETICAL FRAMEWORK 



Manv of the components of teaching and learning theories derive from the Carroll model (OECD, 
2004). Indeed, although often cited as simply an argument for increasing time allocations, Carroll’s 
formulation actually captures important elements of the teaching and learning process, such as qual- 
ity of teaching, opportunity to learn, and student ability within the time framework. This model 
therefore warrants some elaboration. 

In his original 1963 article in the Teachers College Record, Carroll sets out to propose a mathematical 
formulation of the common-sense notion that learning takes place in a time framework. The math- 
ematical formulation of the Carroll model may be stated as: 

The degree of learning or achievement (L) is a function of the ratio of the time actually spent 

on learning (Tsl) to the time needed to learn (Thi), or 

L = f{Tsl/Tnl) 

Although mathematical in form, the model is essentially a conceptual one because the detailed 
nature of the function is unspecified in Carroll’s original formulation. For example, it is not clear 
il the relationship is linear or if there are saturation, fatigue or other effects that might limit the 
value of spending more time on learning. Obviously, at some level, such limits exist. However, in 
practical terms, it is not at all simple to determine when individuals begin to approach these limits. 

Although time is the central construct of Carroll’s model, more specific components, which relate 
to teaching and learning, influence both time spent and time needed. The value of the model for 
studies such as this one derives from these components. Three components cover learner char- 
acteristics: ability, aptitude and perseverance. Ability refers to the underlying mode or style of 
learning relative to a particular task and hence affects time needed. Aptitude can be defined as the 
time needed to achieve mastery of a particular task. Perseverance is simply the amount of time the 
learner is willing to devote to the task. Two other components are characteristic of the learning 
environment: opportunity to learn and quality of instruction. Opportunity to learn is best thought 
of as limited bv the total time available, or allocated time; quality of instruction influences time 
needed. Students exposed to low-qualitv instruction would be expected to require more time to 
learn than those exposed to higher-qualitv instruction. Although generally believed to be of cru- 
cial importance, quality of instruction is one of the most elusive constructs in the model because 
it involves a complex interplay of factors including teacher qualifications, resources and the nature 
of the moment-by-moment interactions that occur between teacher and students. Carroll’s model 
itself offers no specific guidance as to what constitutes high- or low-quality instruction. Much of 
the empirical work on teaching strategies over the past few decades may be seen as a search for the 
essential elements that define high-qualitv instruction. 

Caroll revisited his original 1963 model in a 1989 retrospective. He concludes that optimising aca- 
demic learning time is one of the most important factors in improving student achievement. More 
recent reviews bv Scheerens and Bosker (1997) and Marzano (2003) reinforce this conclusion. 
However, the problem remains of how this optimisation can be accomplished, especially within the 
overall constraints of conventional school years or davs. 
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The Carroll model has been adopted to make a case for more learning time {e.g. Wilev and 
Harneschfeger, 1977) or for organising schools on a variable-time basis, in which students who 
need more time are given more time (e.g. Bloom, 1976), In practice, however, school svstems are 
not organised explicitly in either of these ways and it is difficult to see how such changes could be 
implemented on a large scale within anv jurisdiction. For the most part, anv variations in learn- 
ing time must fit within the global constraints of the school dav and year bv optimising use of the 
total time available within the school, trading off time on one subject against that spent on others, 
or adding to this time through appropriate out-of-School activities such as homework. The present 
studv shifts the focus from looking directlv at time to examining teaching and learning strategies 
that might help optimise time spent and reduce time needed. This approach provides a powerful 
heuristic for policv because it allows policv makers to think in terms of a broad factor over which 
thev mav have some influence. 

A number of factors associated with effective mathematics instruction and effective student learning 
strategies also form part of the time model. These factors include time on task, homework, oppor- 
tunitv to learn, time lost on non-instructional activities, qualitv of curriculum and instructional 
material and qualitv of assessment practices. Manv of the relationships identified are supported bv 
recent research svntheses, particularly those by Wang et al. (1993), Scheerens and Bosker (1997) 
and Marzano (2003) and bv a number of reports based on PISA 2000 (e.g. Kirsch et al, 2002; Artelt 
et al., 2003). 

The Wang et al synthesis is particularly useful because it supports the hypothesis that proximal 
variables are more closelv associated with learning than distal variables. More specificallv, the vari- 
ables showing the strongest relationships with achievement are those in the areas of classroom man- 
agement, meta-cognitive processes, cognitive processes, home environment and parental support, 
and student-teacher social interactions. Motivation, peer group influences, quantitv of instruction, 
classroom climate, and other proximal variables also receive high rankings (Wang et al, 1994). This 
work also shows that variables related to broad state- and district-level educational policies are less 
influential. However, the Wang et al. formulation does not consider the possibilitv of indirect influ- 
ences of such factors, through their more direct impact on instructional processes. 

Some of the more recent svntheses have helped identifv more specific positive influences on achieve- 
ment. For example, Scheerens and Bosker (1997) produce a ranking of school factors found to 
have positive influences on learning. These include time, monitoring, pressure to achieve, parental 
involvement and content coverage. The tvpe of school climate most likelv to enhance learning is 
one with an orderlv atmosphere, rules and regulations, and good student conduct and behaviour. 
Similariv, effective classroom management strategies include direct instruction, monitoring student 
progress and a positive attitude to work. 

Most of the studies in the various svntheses have been small-scale and local in scope and tvpicallv 
cover onlv a few of the manv variables that might be expected to influence learning. Because of the 
large number of variables available and the wide range of contexts used, large-scale survevs such 
as PISA offer the potential to uncover more robust relationships, as well as to investigate the influ- 
ence of variations in context on the results. The extensive coverage of the PISA database allows the 
analvsis of particular factors that may positively or negatively relate to students’ achievement, while 
also taking account of other factors that mav cloud or complicate this relationship. 
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It must also be noted that large-scale surveys have shortcomings in other wavs. In particular, onlv 
partial information can be gathered on teaching strategies because of the limitations of self-report 
questionnaires, the inability to sample adequately at the school or classroom level and the cross- 
sectional nature of these studies. A particular limitation of PISA in this respect is the absence of a 
teacher questionnaire in both the 2000 and 2003 surveys. Such an instrument would make it pos- 
sible to capture much more detailed information on instructional practices and opportunity to learn 
than the student and school questionnaires permit. 

However, cross-sectional studies are unable to capture instructional strategies occurring over the 
student’s whole school career. The data on teaching strategies are thus less stable and cumulative 
than variables on home environment or student characteristics, for example, which reflect the indi- 
vidual’s life experience. The correlations, which are the basis of most of the analysis in this report, 
are therefore likelv to be weaker for teaching and learning strategies than for student background 
variables and weaker than would be expected based on the proximal-distal hypothesis. This limita- 
tion of the data is less of a problem for student learning strategies than for teaching strategies, as one 
might expect the particular learning strategies used by students to be products of their long-term 
exposure to a particular school or school svstem. 

PISA did not collect information on all components of interest within the Carroll model and its 
extensions. For example, it did not examine ability or opportunity to learn. In addition, this report 
does not correlate all of the measures collected in PISA with achievement. For these reasons, and to 
avoid having overly cumbersome models, the report provides two stages of initial selection. First, 
the report uses onlv those variables showing consistent patterns of correlation with mathematics 
achievement across countries. Second, the report drops variables from successive iterations of the 
main models if thev show few significant effects in the presence of other variables in the model. 
Note that the report retains a few variables judged to be of particular policy relevance even if thev 
do not meet these criteria, as it mav be helpful to indicate explicitly that these variables have mini- 
mal effects. 


KEY TEACHING AND LEARNING VARIABLES 

The PISA database contains observed variables representing responses bv students and school prin- 
cipals to all questionnaire items, as well as overall assessment results. Some of the questionnaire 
items ask for facts {e.g. “Do vou have a study desk at home?”). Others require estimates of time or 
other factors (e.^. “How many hours per week do vou spend on homework?”). Finally, some items 
are intended to solicit opinions (e.^. “I do mathematics because I enjov it”). These last items usu- 
ally provide a four-point scale for response, from “strongly agree” to “strongly disagree” or another 
similar scale, such as degree of confidence. 

During the initial design and analysis, many of the questionnaire items combine to form a number 
of derived or index variables, representing broader underlying constructs. For example, the index oj 
disciphnarj climate in mathematics lessons derives from student responses to five items on the student 
questionnaire concerning the extent to which students did not listen to the teacher, could not work 
well, lost time at the start of each lesson by not working or quietening down, and reported noise 
and disorder. For the most part, index variables representing teaching and learning strategies are 
the ones of most interest here. Although more abstract than the observed variables, thev are more 
efficient in building models because thev capture more information in a single scale and because 
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Table 1,1 

Key teaching and learning variables 


Variable 

Scale/unit 

OECD average 

Definition/illustrative 
questionnaire item 

Total homework time 

Hours per week 

5,89 


Mathematics homework time 

Hours per week 

2.43 


Tutoring 

Dichotomous (1,0) 


Student being tutored or not. 

Out-of-class lessons 

Dichotomous (1 ,0) 

» 

Student taking out-of-class lessons or not. 

Memorisation/ 
rehearsal strategies 

Standard score 

0 

When 1 study mathematics, 1 trv to learn the answers 
to problems off bv heart. 

Elaboration strategies 

Standard score 

0 

When I am solving mathematics problems, I often 
think of new wavs to get the answer. 

Control strategies 

Standard score 

0 

When 1 study mathematics, I start by working out 
exactly what 1 need to learn. 

Competitive learning preference 

Standard score 

0 

I make a real effort in mathematics because I want to 
be one of the best. 

Co-operative learning preference 

Standard score 

0 

I do mv best work in mathematics when I work with 
other students. 

Teacher support 

Standard score 

-0,01 

The teacher helps students with their learning. 

Student-teacher relations 

Standard score 

0,01 

If I need extra help, I will get it from my teachers. 

Disciplinary climate 

Standard score 

0,01 

Students don’t listen to what the teacher savs. 

School average disciplinary climate 

Standard score 

0 

Disciplinary climate aggregated to the school level. 


scaling; the index variables in a certain wav more closelv meets the underlving assumptions of the 
models. However, particularlv at the descriptive stage, values for observed variables have also been 
reported because these are more intuitively clear and more directlv descriptive of behaviour. For 
example, one mav interpret the observed variable “noise and disorder in the classroom” in a straight- 
forward wav through response frequencies to the categories used in the questionnaire. 

The teaching and learning variables selected for consideration in the final models are set out in 
Table 1.1. The actual questions that make up manv of the index variables used, as well as the response 
proportions for these questions, appear in much greater detail in Chapter 3 of Learning for Tomorrow’s 
World: First Resultsjrom PISA 2003 (OECD, 2004). 

CONTROL VARIABLES 

The report treats student socio-economic background, attitudes and motivations as antecedent condi- 
tions, which should be adjusted for in developing models designed to investigate the effects of teach- 
ing and learning strategies on achievement. This report recognises that the direction of causalitv is 
problematic in models based on correlational methods and that other analytical approaches could treat 
attitude or engagement variables either as outcomes or as attributes that might actuallv be taught as 
indirect wavs of improving achievement. For example, it is commonlv argued that high self-concept 
is a by-product of high achievement or that teaching should be designed to ensure that student self- 
concept is not damaged. These issues, though interesting in their own right, are not addressed here. 

The control variables used in the models developed for this report appear in Table 1.2. Again, fur- 
ther details on the index variables appear in Learnina for Tomorrow’s World: First Results for PISA 2003 
(OECD, 2004). 
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Table 1.2 

Control variables 





Definition /illustrative 

Variable 

Scale/unit 

OECD average 

questionnaire item 


Socio- 

-economic status 

Highest occupational status of parents 

Standard score 

48,79 

Scaled score from student-reported parent 
occupations. 

Highest educational level of parents 


4,19 

6 -point scale of standard international educational 
levels (based on ISCED) from student-reported 
educational level of parents. 

Books in home 


3.50 

6-point questionnaire scale, 0-10=1 , more than 500=6 

Attitudes 

Interest and enjovment of mathematics 

Standard score 

0 

I look forward to mv mathematics lessons. 

Sense of belonging in school 

Standard score 

0 

School is a place where 1 feel like 1 belong. 

Mathematics anxiety 

Standard score 

0 

I get verv nervous doing mathematics problems. 


Perceptions of 

mathematics competency 

Mathematics self-efficacv 

Standard score 

0 

How confident do vou feel about having to do ... 
(selected mathematics tasks)? 

Mathematics self-concept 

Standard score 

0 

1 get good marks in mathematics. 

Motivation 

Instrumental motivation 

Standard score 

0 

I will learn manv things in mathematics that will 
help me get a job. 

School variables 

School size 

100 students 

5.36 

Total school enrolment/100. 

School average highest occupational 


46,98 

Highest occupational status of parents aggregated 

status of parents 



to school. 


OTHER VARIABLES 

As already indicated, the report excludes some variables identified in the original formulation from 
the main models used here because in general they show non significant correlations with achieve- 
ment or small effects in early iterations of the model. Many of the school-level questionnaire varia- 
bles are in this category. Some examples of these variables are those around streaming and grouping 
and assessment practices. The report retains total instructional time and mathematics instructional 
time through to the final model but these show non-significant effects throughout. Because they are 
useful indicators of differences between countries and between schools within countries, the report 
discusses some of these variables as part of the descriptive analysis presented in Chapter 2. These 
variables are also of policy interest and show significant effects in other studies. 

OVERVIEW OF THE ANALYTICAL APPROACH 

This report follows a two-stage analytical approach. Chapter 2 reports on the first stage. It includes 
a descriptive/comparative analysis of mathematics teaching and learning that describes how math- 
ematics is taught in different countries, examines variations across schools within countries, and, 
based on this analysis, presents a broad profile of commonalities and differences in mathematics 
teaching and learning. While limited in their ability to provide explanations for differences in math- 
ematics teaching methodology, the Chapter 2 results inform policy makers in individual countries 
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ght differ from that of other countries in terms of consistency or variety 


Chapter 3 reports on the second stage. This stage requires the construction of a comprehensive 
two-level (student and school) prediction model of the factors influencing mathematics achieve- 
ment. Primary emphasis is on the teaching and learning strategy variables described in Table 1.1. 
Following the temporal logic described earlier, the control variables as given above in Table 1.2 are 
antecedents to teaching and learning and hence entered into the model in stages, before the teaching 
and learning variables. This approach allows the predictive power of the model to be determined 
as groups of variables enter in stages. Nevertheless, the basis of the final reporting of the effects of 
each of the main variables is the full model. While this limits the ability to examine in detail the 
joint and mediating effects of variables, the full model gives a more complete picture of the real 
world of teaching and learning than do the intermediate models. The intermediate models mav be 
of more theoretical interest while the full model is of more interest from a policy perspective. The 
report then examines mediating effects in part bv comparing effects using the full model with those 
for each variable used independently (a bivariate model). 


Further details on the analytic procedures used are given at the beginning of Chapters 2 and 3. 


Note 


1 The asterisks in Table 


indicate where onlv proportion information is available. 
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This chapter reports on the observed associations between various aspects oj teaching and 
learning strategies and mathematics performance. The chapter examines characteristics 
oJ students, schools and countries and studies the distribution these characteristics. 
This kind of examination leads to a number of questions such as: Hoiv much do students 
benfitfrom a classroom atmosphere that is conducive to learning? To what extent do some 
students employ more effective learning strategies or devote more time to learning than 
others? Do individual countries’ education systems provide dfferent conditionsfor teaching 
and learning to dfferent students and in dfferent schools? 
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INTRODUCTION 



To what extent do students aged 1 5 benefit from teaching and learning strategies associated with 
the acquisition of mathematical competence? This chapter looks at characteristics of students, 
schools and countries in terms of various features of teaching and learning. It studies in particular 
the distribution of these characteristics. For example, to what extent do some students benefit 
more than others from a classroom atmosphere conducive to learning? To what extent do some 
students emplov more effective learning strategies or devote more time to learning than others? Do 
individual countries’ education svstems provide different conditions of teaching and learning for 
different students and in different schools? 

This chapter reports on the extent to which there are observed associations between various aspects 
of teaching and learning and mathematics performance. The analvsis reveals the extent to which 
the factors whose presence or absence is being investigated are those that tend to go together with 
higher student achievement. It does not describe the extent to which teaching and learning strate- 
gies leads to higher performance; this information appears in Chapter 3, which uses modelling to 
explore how such strategies mav or mav not be related to outcomes. 

A compelling case can be made that mathematics is fundamentallv a school subject. It is difficult to 
imagine that anv significant level of mathematical competence, particularlv in its more formalised 
sense, could be acquired outside of the school setting. Onlv the most motivated students will be 
able to acquire anv significant level of mathematical competence, particularlv in its more formalised 
sense, outside the school setting. In this respect, mathematics learning happens in a different way 
from language learning. There is no direct mathematical equivalent of the bedtime storv, nor is 
mathematics used, in anvthing other than a rudinientarv wav, in evervdav communication among 
people. At the same time, full participation in manv modern societies requires more than a basic 
knowledge of mathematics, and a high level of mathematical competence is essential in manv occu- 
pational areas. In addition, mathematics is the foundation of much of the scientific and technical 
activitv that distinguishes advanced from less advanced societies. Developing students’ mathematical 
competence at a much higher level than is required for evervdav communication is thus a goal of 
most school programmes. 

One can hvpothesise that school and classroom activities should have more impact on overall math- 
ematics achievement than on overall language achievement. Almost all students in OECD countries 
have expo.sure to mathematics teaching at least up to the age of 15, the age level assessed in PISA. 
To what extent can differences in student performance be attributed to differences in the level of 
exposure to mathematics instruction? More particularlv, is it possible to associate differences in 
performance with the various different approaches to teaching and learning? In investigating the 
extent of all these differences, this chapter concentrates on differences among schools and students 
within countries, which are greater overall than differences across countries. 

FACTORS DESCRIBING TEACHING AND LEARNING 

PISA uses students’ and school principals’ responses to questionnaires in order to construct indi- 
cators of teaching and learning. As described in Chapter 1 , PISA has developed a series of indices 
which are the indicators of teaching and learning strategies presented in this report, such as the 
index oj disciplinary climate in mathematics lessons and the index oj co-operative learning. Each index is 
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derived from students’ reports on a number of statements. For example, the index oj disciplinarj 
climate in mathematics lessons is derived from student responses to five statements, including how 
frequentlv there was noise and disorder in their mathematics lessons (“everv lesson”, “most lessons”, 
“some lessons”, “hardlv ever” or “never”). This chapter presents descriptive information on student 
responses to each of the statements within the PISA indices. Please note that the bases of all model- 
ling in Chapter 3, however, are the PISA indices. 


While the main purpose of this chapter is to provide a profile of teaching and learning, it also sup- 
plies preliminarv indications as to whether the factors described have anv relationship with student 
performance in mathematics. This analvsis is important in order to pick out those factors which 
might be significant in the overall picture of teaching and learning. For example, anv discussion 
of how much homework is given in different schools should reference the investigation of whether 
more homework produces better learning outcomes. However, the simple effects of each factor on 
student performance in mathematics reported in this chapter should be treated with caution, just 
as first indications. First, PISA is a cross-sectional studv and therefore cannot demonstrate that 
certain student or school characteristics lead to better performance. Rather, PISA shows associa- 
tions or relationships between particular student or school characteristics and student performance. 
These “bivariate” associations — that is, the simple effect of the factor on student performance, not 
taking into account anv other factors — do not indicate causalitv and, to a varving degree, mav exist 
because of their correlation with other teaching and learning or background factors. For instance, 
if students who experience an orderlv classroom environment do well in mathematics but also tend 
to come from sociallv advantaged home backgrounds, it might be their home advantages rather than 
the atmosphere in which thev learn, or a combination of the two, which explain the relationship 
with performance. Indeed, there is likelv to be a link between these two factors, as students from 
more advantaged backgrounds are probablv going to be better attuned to the culture and expecta- 
tions of the school. Chapter 3 explores these interactions and separates out the unique effects of 
each factor. 


This chapter examines variation in teaching and learning strategies within countries, especiallv 
among schools within countries. The analvsis therefore centres around within-countrv distributions 
as represented bv percentile ranks. The wider the range of values covered in these distributions, the 
greater the variability in teaching and learning within countries. In particular, the analysis consid- 
ers such variations across schools bv looking at the distribution of school-level results. Use of time 
and teaching strategies mav logicallv be seen as characteristics of a school and not of an individual 
student.' On the other hand, one may logicallv consider student learning strategies as character- 
istic of individuals, as well as being influenced bv school characteristics and teaching strategies. 
The chapter examines student learning strategies in terms both of variation among students and of 
variation among schools. 

The analysis below looks in turn at four broad groups of variables: time inputs, student learning 
strategies, teaching strategies and the learning climate. 
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ALLOCATION AND USE OF TIME 

Overview 

Much research on teaching and learning is grounded, at least implidtlv, in the issue of allocation and 
use of time. The Carroll model (Carroll 1963 and 1989) and variations on this model have provided 
the theoretical underpinning for the investigation of time allocation and use. Researchers accept the 
fundamental proposition that learning is a function of time (though obviously not of time alone), 
although the details of that functional relationship continue to be the subject of research and debate. 
Many other factors that affect learning can be formulated in terms of time. For example, a posi- 
tive disciplinary climate mav be conceived as one that minimises lost time and maximises the time 
students spend on tasks. Similarly, motivation can be considered, to some degree, as time spent in 
perseverance, one of the factors explicitly identified in the Carroll model. 

From a policy perspective, time is important because central authorities can regulate overall time 
allocations, such as the length of the school year and school day — and sometimes time allocations 
to specific subject areas. In addition, more detailed measures of time such as the length of class 
periods, transition times, homevyork and time spent on tasks in the classroom may be modified 
through school and district policies and through particular teaching and learning strategies. Indeed, 
many teaching strategy variables mav be conceptualised as strategies for maximising time on task. 

The PISA 2003 survey produced results on three main aspects of time use: instructional time, 
extra tuition and homework. These aspects cover the main identifiable time that students spend 
on learning activities. Table 2.1 summarises the results for these three areas. It shows that in a few 
countries, there are large variations in the time devoted to learning, but manv countries have school 
systems with low variability in this respect. Norway epitomises the latter group, where invStruction 
time is uniform, where only a tiny minority take out-of-School classes and students report doing 
similar amounts of homework. By contrast in Mexico, weekly instruction time varies greatly from 
one school to another, most students have extra tuition outside school and whereas one-quarter of 
students do more than seven hours of homework per week, one-quarter do less than four hours. 

Are these differences important? The PISA survey can provide only limited answers to this ques- 
tion. Inconsistencies in the measures of instructional time (see below) have led to its relationship 
to performance not being modelled in this case. For example, time spent on extra tuition may help 
students perform better in mathematics, but since it is often weaker .students who need to have this 
extra help, it is not associated with higher achievement. However, students spending more time 
doing homework overall tend to do better in mathematics in most countries, but the size of the dif- 
ference is generally small. Thus, PISA provides a tool to compare variations in learning time, while 
offering little evidence on their effects (see also Chapter 3). 

Instructional time 

The report measures total instructional time bv questions on the school questionnaire about the 
number of weeks in the school year and questions on the student questionnaire about the length 
of class periods and the number of class periods per week. The product of these two constitute an 
index oj total minutes per week. The product of period length and total mathematics periods per week 
gives an index oJ total mathematics minutes per week. Finallv, the ratio of mathematics minutes to total 
minutes yields an index oJ the proportion oJ total rime that is spent on mathematics. 
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The distributions of number of weeks in the school year appear in Table A.l of Annex A, 
Descriptive Statistics.^ On average in the OECD countries, the school vear consists of 37 weeks, 
with most countries within two weeks of this average. However, the Czech Republic and the 
partner country Brazil have a 41 -week school year, while Mexico averages only 24 weeks. Indeed, 


Table 2.1 

Distribution of learning time and relationship with performance 




How is this associated 


How much does this vary within each country? 

with performance? 


Variability within middle half of schools (interquartile range) 

(Bivariate effect on mathematics 

OECD average 

except where specified 

score, significant effects only) 

Instruction time 

36.7 instructional 

OECD average range = 1 .9 weeks 

No analysis 

weeks per year 

Most variability: 6 to 9 weeks in Hong Kong-China, Japan, the 
Slovak Republic and in Indonesia 

Least variability; 0 weeks in Denmark, Finland, Greece, 
Luxembourg, Norway, the United Kingdom and the United 
States, and in Latvia, Serbia and Thailand 


24.4 instructional 

OECD average range = 3.9 hours 


hours in school week 

Most variability: 1 3 hours in Mexico and 20 hours in the United 



States 



Least variability: <1 hour in Norway, the United Kingdom, 
Finland and Luxembourg, and <2 hours in Latvia and Poland 


888 total instructional 

OECD average range =155 hours per year 


hours per year 

Most variability: 702 hours in the United States, 333 to 260 hours 
in Austria, Hong Kong-China, Mexico, Uruguay and Japan 
Least variability: <90 hours in Norway, Greece, Finland, 
Luxembourg, the United Kingdom, Denmark, the Czech 
Republic, Latvia, Iceland and Hungary 


Extra tuition 

20% of students 

Tutoring in total and in mathematics: 

Negative: students receiving 

report being tutored 

Highest percentages: 90% of students in Mexico, 53% in Turkey 

extra help tend to be weaker 

(individually) in 

(total only) 

performers 

total and 1 5% in 

Lowest percentages: fewer than 10% of students in Finland, 


mathematics 

Denmark, Norway, Japan, Belgium, Sweden, Liechtenstein and 
Netherlands 


25% of students report 

Out-of-school lessons in total: 


attending out-of-school 

Highest percentages: 92% in Mexico, 67% in Turkey and 66% in 


lessons (in groups) 

Greece 


in total and 1 3% in 

Lowest percentages: <10% in Germany, Austria, Norway and 


mathematics 

France 


Homework 

Students report doing 

OECD average range = 2.7 hours 

Positive in 24 countries; in 7 

5.9 hours per week of 

Most variability: 5.9 hours in Italy, 4.7 hours in Hungary, 4.4 

where effect is strongest, each 

homework or other 

hours in Greece and 4.2 hours in the Russian Federation 

hour of homework associated with 

study set by teachers 

Least variability: 1 .5 hours or less in Finland, Sweden, Denmark 

3 score points in mathematics. 

in total 

and Luxembourg 

Negative in 4 countries. 

Students report 

OECD average range = 1 hour 

Positive in 10 countries, negative 

doing 2 ,4 hours per 

Most variability: 2.1 hours in Macao-China and Thailand and 1,7 

in 18, But performance difference 

week of homework 

hours in Italy 

small over observed range of 

or other study set by 

Least variability; 0,5 hours or less in Luxembourg, Finland and 

homework practice. 

mathematics teachers 

Liechtenstein. 
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onlv one-quarter of all schools in Mexico report at least 23 school weeks per vear,^ although a few 
Mexican schools do have much longer years, with 5% of schools reporting at least 42 weeks per 
vear. 

As the example of Mexico indicates, there are striking differences in the variation of number of 
instructional weeks in the school vear within different countries. In one-half of the participating 
countries, the school vear is more or less a standard length (varving bv no more than one week). 
In Japan, the Slovak Republic, as well as the partner economies Hong Kong-China and Indonesia, 
the quarter of schools with the longest school vears have at least six weeks more school time than 
the quarter of schools with the shortest school vears. While this finding might relate to the degree 
of central direction of school svstems, countries as different as the United States and the partner 
countrv Latvia are among those with little variation in the school vear, while Japan and the partner 
economv Hong Kong-China have wide variations, despite their relativelv centralised education 
svstems. 

The distributions of total weeklv instructional time appear in Table A. 2. Overall, the average 
amount of instructional time in a school week in the OECD countries is 24.4 hours. Again, the 
variation across countries is considerable, with the longest weeks in Korea and the partner country 
Thailand (around 30 hours each), and the shortest in the partner countrv Brazil (19 hours). In fact, 
the ratio of the most to the fewest hours in the school week (1 .6) is similar to the ratio of the most 
to the fewest weeks in the school vear (1.7). The United States, Austria, Mexico, Japan, Korea and 
Italv, as well as the partner economies Hong Kong-China, Uruguav and Brazil, show the great- 
est internal variation in length of week (at least 200 hours difference between the 25^*^ and 75*'’ 
percentiles). 

Combining the number of weeks in the school vear with the instructional time per week gives an 
index of total instructional time per year. The distributions for this index appear in Table A. 3. Overall, 
students in the OECD countries receive an average of 888 hours of instruction per vear. Most 
OECD countries, with the exception of Korea (1074 hours), Austria (991 hours) and Mexico 
(565 hours), fall within a range of 85 hours, or about 10% of the total. The partner economies 
Thailand, Liechtenstein and Macao-China all provide over 1000 hours of instruction per vear. The 
amount of total instructional time per vear varies substantially among schools within each countrv: 
within most countries, there is a difference of 400 or more hours between schools at the 5‘^ and 
95*^ percentile on this measure. 

These figures are partially inconsistent with those reported bv the OECD (2005). This finding 
raises some concern about the reliability of some of the time figures as reported bv students, which 
mav account for unusually low correlations found between some time indices and achievement. 
For this reason, the report excludes manv of the time indices from the final model presented in 
Chapter 3. However, the Carroll model suggests that the large variations in time allocation between 
countries and between schools is likely to be of greater significance for mathematics achievement 
than the results here would indicate. In order to allow a more thorough investigation of this issue, a 
method of obtaining consistent measures of these major elements of time needs to be found. 

The distributions of hours per week devoted to mathematics instruction appear in Figure 2.1. In 
the OECD countries, mathematics instructional time averages 3 hours and 18 minutes per week. 
Among countries, means varv from around 4.5 hours in the partner economies Hong Kong-China 
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Figui-e 2.1 ■ Hours per week spent on homework for mathematics and other subjects 
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Note: Countries are ranked in ascending number of hours per week of mathematics homework. 

1 . Response rate too low to ensure comparability. 

Source: OECD PISA 2003 Database. 
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and Macao-China to 2,5 hours in the Netherlands, close to a two-fold difference. In addition, on 
average in the OECD the within-countrv variation in mathematics teaching time per week is 1 
hour (see Table A. 4). However, Canada stands out as the OECD countrv with the most pronounced 
differences: a quarter of all students spend less than 1.5 hours a week learning mathematics, while 
another quarter spend nearlv six hours or more. 

Tutoring and out-of-school classes 

Some students participate in organised mathematics learning outside the regular school programme, 
mainly in the form of being tutored or attending additional classes in school subjects. The differ- 
ence between these is essentiallv whether the instruction is individual or group based. There may 
be manv reasons for such activities. In highlv competitive svstems, for example, these activities mav 
be seen bv students and parents as a means of obtaining a competitive edge. Even in less competitive 
environments, tutoring and other out-of-school work mav be a means of attaining high achieve- 
ment, improving the performance of students who are not doing well or compensating for perceived 
limitations in what the school can provide. 

Ill the questionnaire, students report the number of hours per week thev work with a tutor and 
spend attending out-of-School classes, both overall and specificallv in mathematics. Because rela- 
tivelv few students in most countries report anv time at these activities, it is not meaningful to 
reproduce or compare average times bv school. Instead, for each country the report provides a 
computation of the proportion of students declaring anv time spent at these activities, and the 
most common (modal) number of hours per week for those reporting non-zero time. These results 
appear in Figure 2.2. 

It is clear that this extra tuition plays a much greater role in some countries than others. Almost 
all students in Mexico report that thev are both tutored and attend out-of-school classes. The pro- 
portions are also quite high in Greece and Turkev.^ However, in most countries, the proportions 
of students reporting tutoring in mathematics are considerably smaller, averaging 20% overall and 
15% for mathematics across the OECD countries. 

It might be expected that high proportions of time spent on these activities would be associated with 
shorter school weeks, indicating that students find ways to compensate for limited instructional 
time. However, these measures are essentiallv uncorrclated. That being said, within most countries 
there is a distinct negative correlation with mathematics performance (see Chapter 3). This finding 
indicates that tutoring and extra classes tend to help compensate for weak performance more than 
to support alreadv able students to advance further. The likelihood that students will take extra 
tuition if thev are weak performers makes it verv difficult to assess its overall value in a studv that 
does not track individual students: in PISA, no link can be made between extra tuition and good 
performance. 

Homework 

There is a considerable literature supporting the claim that homework is a factor contributing to 
achievement (Marzano, 2003). However, lack of controls for abilitv in manv studies, and thus 
the possibilitv that lower-abilitv students will spend more time at homework than their higher- 
abilitv peers, confounds this relationship. The PISA student questionnaire asks two questions about 
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Fi^ui-e 2,2 ■ Hours per week spent on tutoring and out-of-school classes 


Tutoring 


Classes outside school 
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Modal hours 
per week in; 

All sub- Math- 

Mexico + 1 

Turkey 4 2 

Greece 4 4 

Brazil 4 1 

Korea 4 4 

Tunisia 2 2 

Latvia 4 

Spain 4 2 

Russian Fed, 4 1 

Poland 2 1 

Hungary 1 1 

Thailand 4 2 

Uruguay 2 1 

HongKong-China 2 2 

Switzerland 1 1 

Czech Rep. 2 1 

Luxembourg 4 1 

Italy 4 1 

Macao-China 4 1 

Liechtenstein 1 1 

japan 4 2 

Canada 4 1 

Portugal 2 1 

Ireland 1 1 

Iceland 2 1 

New Zealand 1 1 

Slovak Rep, 2 1 

Finland 2 1 

United States 4 1 

Australia 4 1 

Belgium 2 1 

Serbia 2 1 

Denmark 2 1 

Sweden 1 1 

France 1 1 

Norwav 1 1 

Austria 2 1 

Germany 2 1 

United Kingdom 1 1 

0°'^ 20 40 60 80 100 


Percentage of students 
attending out-of-school classes 



H All subjects I Mathematics 


Note: Countries are ranked in descending order of the percentage of students either being tutored or attending out- 
of-school classes in all subjects. 

1. Response rate too low to ensure comparability. 

Source: OECD PISA 2003 Database. 
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homework: the first on hours per week of homework set bv all teachers and the second on hours 
per week of homework set bv mathematics teachers. For total time spent on homework each week, 
there is in fact a positive correlation with performance (see Chapter 3); this is consistent with the 
other research showing the benefits of homework. 

There are marked differences between countries in the total amount of homework reported (see 
Table A. 5). The partner countrv, the Russian Federation, reports most total homework, a mean of 
more than 12 hours per week. In addition, Italy, Hungarv, the Slovak Republic, Greece and Poland, 
and the partner countrv Latvia, also show mean homework times of between 8 and 10. 5 hours. At 
the other extreme, mean homework times per week are less than 4 hours in Korea, Finland, Japan, 
the Czech Republic, Sweden and Austria. 

If homework is beneficial, to what extent are students in some schools disadvantaged compared to 
others bv doing less homework? The largest variations across the middle 50% of schools, in hours, 
occur in Italv, Hungarv, Greece, and the partner country, the Russian Federation, as depicted in 
Figure 2.3. The variation is great relative to the (sometimes small) national average for homework in 
certain other countries as well. For example in Japan, the quarter of students with the least home- 
work do a maximum of 1 hour and 48 minutes each week, while the quarter with the most do over 
4.5 hours. In Hungarv, the bottom quarter do up to 7 hours and 42 minutes, but the top quarter do 
over 12 hours’ homework per week. Students in all schools in the top quarter do more than twice 
as much homework as students in the bottom quarter in Japan and the Netherlands. The ratio of 
the top to the bottom quarter of schools is at least 1.8 in Australia, Austria, Belgium, Canada, the 
Czech Republic, Italv and Mexico, and the partner economies Hong Kong-China and Thailand, 
showing that in general there are important differences between the homework norms of schools 
and that this finding does not just applv at the extremes of the distribution. 

The pattern for mathematics homework times is similar to that for total homework, with close cor- 
relation between countrv rankings for both (see Table A, 6). 


Other components of time 

The PISA student questionnaire also contains a number of questions about time spent on remedial 
and enrichment activities and other school-related work. Unfortunatelv, the responses for these 
questions are too unreliable to report. The absence of large amounts of data for manv countries 
suggests that manv Students may simplv have left the response blank if the amount of time spent on 
such activities was zero. In addition, in manv countries the same students reported participation 
in both remedial and enrichment activities. Since this seems implausible, it is possible that many 
students misinterpreted these questions. 


STUDENT LEARNING STRATEGIES AND PREFERENCES 

A series of questions about how students studv mathematics forms the assessment of student learn- 
ing strategies. A second related set of questions asks whether students prefer a competitive or co- 
operative environment for learning mathematics. In both cases, students indicate, using a four-point 
scale, their degree of agreement or disagreement with a series of statements about how thev learn 
mathematics. These items on learning strategies form the basis for three indices: the index oj memo- 
risation/ rehearsal, the index of elaboration strategies and the index oJ control strategies. Collectivelv, these 
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Figut-e 2.5 ■ Hours per week of homework or other study set by teachers in total 


Mean 

Russian Fed. 12.7 
Italy 10.5 
Hungary 9,9 
Latvia 9.4 
Slovak Republic 8,3 
Greece 8,3 
Poland 8.1 
Macao-China 7.8 
Ireland 7.7 
Spam 7,3 
Thailand 6,9 
Uruguay 6,7 
Hong Kong-China 6,7 
Germany 6,2 
Belgium 6.1 
Luxembourg 6.0 
Turkey 5,8 
Mexico 5,7 
Canada 5,7 
Australia 5,7 
Netherlands 5,7 
United States 5.6 
Denmark 5.4 
Serbia 5,2 
Portugal 4,9 
Norway 4.8 
Brazil 4,8 
Tunisia 4,7 
Iceland 4,6 
Switzerland 4.5 
New Zealand 4,5 
Liechtenstein 4.4 
Austria 3,9 
Sweden 3,9 
Czech Republic 3,8 
japan 3,8 
Finland 3.7 
Korea 3,5 

United Kingdom' 6,0 

0 4 8 12 16 20 

Hours per week 

Note: Countries are ranked in descending order of the average number of hours spent on homework or other study 
set bv teachers in total. 

1 . Bars extend from the 5th to the 95th percentile. At the 5th percentile only 5% of schools have fewer hours per week 
of homework. A school at the 95th percentile has more hours per week of homework than 95% of the other schools. 
The darker middle section denotes the variation between the middle 50% of schools (25th and 75th percentiles). 

2. Response rate too low to ensure comparability. 

Source: OECD PISA 2003 Database. 
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are meta-cognitive strategies because thev represent general rather than content-specific approaches 
to the cognitive processes involved in learning. Research has shown that meta-cognitive skills and 
self-regulated learning strategies are important components of effective independent learning 
(Zimmerman and Schunk, 2001). 


Readers are cautioned that the PISA 2000 analvsis of student learning strategies shows limitations 
in comparing the overall use of these strategies across countries. Evidence suggests that in manv 
cases students mean different things in different cultures when answering questions about their 
learning strategies. In this survev, there is also evidence to suggest that students in some countries 
replv to the same question in general with greater optimism or pessimism than do students in other 
countries, producing a response bias. For example, students in Finland, Japan, Korea, and the 
Netherlands tend to agree that thev adopt various learning strategies much less than do students in 
Mexico and the partner countries Brazil and Tunisia, despite the much lower performance in PISA 
of students in the last three countries 


Table 2.2 

Distribution of the use of learning strategies/preferences and relationship with performance in mathematics 


Variable 

How much does this vary within each country? 

Variation within middle half of schools (interquartile range) 
Measured on index scale standardised relative to international 
standard deviation of individual learner characteristics 

How is this associated with 
performance? 

(Bivariate effect on mathematics 
score, significant effects only) 

Use of learning strategies 

Memorisation/ 

rehearsal 

OECD average range: 0.30 standard deviations 
Most variability: 1 .04 in the partner country Liechtenstein, 
0.50 in Germany, 0.44 to 0.42 in Austria, Switzerland, Mexico, 
the United States and in the partner country Indonesia 

Positive association in 17 countries, 
negative in 14. (When accounting for 
other factors, mainly negative: see 
Chapter 3.) 


Least variability: 0,17 in Luxembourg, 0.21-0.23 in Greece 
and Japan, and in the partner economies Thailand, Latvia and 
Macao - China 


Elaboration 


OECD average range; 0.32 

Most variability: 0,56 in Austria, 0.47 in Germany, 0.45 in Italy 
and 0,46 in the partner country Liechtenstein 
Least variability: 0,21 in Portugal and Finland, and in the partner 
economies Latvia and Macao-China 


Positive association in 2 5 countries, 
negative in just one. (When 
accounting for other factors, mainly 
negative: see Chapter 3,) 


Control 


OECD average range; 0.31 

Most variability; 0,52 in Korea, 0,41 in Canada, Mexico and 

Germany, 0,40 in Belgium and Turkey 

Least variability: 0,21 in Finland, 0,22 in Luxembourg, 

0.23 in Hungary, 0.19 in the partner country Latvia and 0.23 
in the partner country Thailand 


Positive association in 21 countries, 
negative in just one, (Mixed picture 
when accounting for other factors: 
see Chapter 3,) 


Learning preferences 


Preference for OECD average range; 0.35 Positive association in 29 countries, 

competitive learning Most variabilitv; 0.5S in Austria, 0.S3 in Korea, 0.4S in Italy and negative in none. (Most countries 
0.46 in the partner country Liechtenstein ’ "Fen accounting for 

other factors: see Chapter 3.) 

Least variability: 0.15 in the partner economy Macao-China, 

0.1 9 in Greece and 0.20 in the partner country Latvia 


Preference for OECD average range; 0.30 

co-operative learning Most variabilitv: 0,42 in Austria, 0,41 in Mexico, 0.40 in Korea, 
the United States and in the partner country Serbia 
Least variability; 0.20 in Australia and Hungary, 0,21 in Finland, 
0.22 in Greece and the partner country Thailand 


Positive association in 9 countries, 
negative in 15. (Most countries show 
no effect when accounting for other 
factors: see Chapter 3,) 
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Students’ preferences for learning situations influence learning behaviour; PISA presents two 
indices on this. Students who trv harder to learn mathematics so that thev can be the best in their 
class or obtain the best marks in their mathematics tests show a preference for competitive learn- 
ing, while students who report that thev work best with other students show a preference for 
co-operative learning. Preferences for competitive or for co-operative learning are not mutuallv 
exclusive and students could report a preference for both learning situations. These are relatively 
straightforward concepts, representing a combination of student dispositions and the climate of the 
school and the society in which the student functions. 


Table 2.2 gives an overview of the results, in terms of the variabilitv of the use of learning strate- 
gies/preferences in different schools and the degree to which these strategies are associated with 
performance. Similar patterns emerge for each learning strategv. In each case, a group of countries 
with the smallest school differences shows less than one-half the variabilitv seen in countries with 
the greatest differences. How much this matters depends on the degree to which particular learn- 
ing strategies help improve student learning, and on this question, there is a mixture of evidence. 
Overall, the factors that are most commonlv associated with strong results are the controlling of 
one’s own learning and a preference for competitive learning. (Note that this preference is not an 
alternative to a preference for co-operative learning, and it is possible to be positive about both.) 
But the associations shown here, and in particular that between controlling one’s learning and PISA 
performance, appear to be weaker and less consistent for mathematics than for reading, as reported 
for PISA 2000 bv Artelt et al. (2003). This evidence mav indicate that different strategies have a 
different impact on learning in mathematics as compared to reading. 

The following analvsis therefore concentrates on the within-countrv distribution of these learner 
characteristics. Country-specific response bias does not necessarily affect the within-country 
models that form the basis for subsequent analysis. However, the possibilitv that various sub-groups 
within countries respond differentlv cannot be ruled out. It is impossible to be sure whether 
response bias contributes to these differences. 


Memorisation/rehearsal strategies 

Students use memorisation strategies {e.g. learning facts or rehearsing examples) for manv tasks; 
such strategies are appropriate when the learner needs to retrieve information, as presented, with- 
out anv further elaboration or processing. To measure the extent to which students use memorisa- 
tion strategies in participating countries, the PISA index oj memorisation strategies derives from the 
following four items: 


STQ34f I go over some problems in mathematics so often that I feel as if I could solve them in 
mv sleep (sleep). 

STQ34g When I studv for mathematics, I trv to learn the answers to problems off bv heart 
(heart). 


STQ34i In order to remember the method for solving a mathematics problem, I go through the 
examples again and again (examples). 

STQ34m To learn mathematics, I trv to remember everv step in a procedure (procedure). 
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Figure 2.4 shows the percentage of students in each country agreeing or strongly agreeing with 
these statements and the distribution across schools of the memorisation index. The first point to 
note is that in most countries substantially more students Say they go through examples and remem- 
ber steps in procedures than say they learn by heart or in a way that means they can solye problems 
in their sleep. A large majority of students clearly use examples and procedures as memorisation 
tools. It is likely that the sleep and heart questions represent more extreme methods of memorisa- 
tion than the examples and procedures questions. 

Memorisation is the one learning strategy that appears from the PISA 2000 results to allow direct 
comparisons across countries. In PISA 2003, there are wide differences across countries in the 
extent of use of memorisation strategies. Students report a comparatiyely higher use of memorisa- 
tion strategies in Mexico and in seyeral of the partner countries (notably Indonesia, Brazil, Thailand 
and Tunisia), followed by the United States, Australia, Greece and Canada. Conyersely, students in 
Japan, Denmark, Korea, Finland and Switzerland and in the partner country Liechtenstein report a 
comparatiyely low use of memorisation strategies. For the most part, the distribution across schools 
on these yariables is symmetrical, with similar numbers of schools at both the high and low ends. 

As shown in Figure 2.4, relatiyely wide differences in the use of memorisation in different schools 
appear in Germany, Austria, Switzerland, Mexico and the United States, and the partner countries 
Liechtenstein and Indonesia. 


Elaboration strategies 

Elaboration is a measure of the extent to which students acquire understanding of new material by 
relating it to prior learning and knowledge. Elaboration strategies, unlike memorisation strategies, 
can help to deepen students’ understanding of the knowledge and skills in use. The PISA index oj 
elaboration strategies deriyes from the percentage of students agreeing or strongly agreeing with the 
following fiye items: 

STQ34b When I am solying mathematics problems, I often think of new ways to get the answer 
{new waj^. 

STQ34e I think of how the mathematics I haye learnt can be used in eyeryday life {everyday). 

STQ34h I try to understand new concepts in mathematics by relating them to things I already 
know {already know). 

STQ34k When I am solying a mathematics problem, I often think about how the solution might 
be applied to other interesting questions (applied). 

STQ34n When learning mathematics, I try to relate the work to things I haye learnt in other 
subjects {other subjects). 

The data for these questions and the index oJ elaboration appear in Figure 2.5. In general, learning 
new ways, applying mathematics to eyeryday eyents, and relating concepts to things already known 
are more preyalent than applying solutions to other interesting questions or relating work to learn- 
ing in other subjects. Here, some of the widest differences among schools are in Austria, Germany, 
Italy and the partner country Liechtenstein. Very narrow differences in countries such as Portugal, 
Finland and Poland, and the partner economies Latyia, Macao-China, Indonesia and Thailand, 
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Figui-e 2.4 ■ Students’ use of memorisation/rehearsal strategies to learn mathematics 



I go over some problems in mathematics so often that I feel as if I could solve them in mv sleep. 

When I study for mathematics, I trv to learn the answers to problems off by heart. 

In order to remember the method for solving a mathematics problem, 1 go through the examples again and again. 
To learn mathematics, 1 trv to remember every step in a procedure. 


Variation in students’ use of memorisation strategies 
among schools within each country ' 
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Note: Countries are ranked in descending order of variation among the middle 50% of schools 
in use of memorisation strategies. 

1 . At the 5th percentile students at onlv 5% of schools have less of a preference for the use of 
memorisation strategies. Students at a school at the 95th percentile have a stronger prefer- 
ence for the use of memorisation strategies than students in 95% of the other schools. 

2. Response rate too low to ensure comparability. 

Source: OECD PISA 2003 Database. 
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imply that learning by using elaboration strategies in these countries follows yery consistent patterns 
across schools. Note, however, that students’ average use of elaboration strategies varies greatly 
among these countries: comparatively fewer students in Finland report using elaboration strate- 
gies compared to other students in OECD countries, whereas in the other countries comparatively 
more students report that they use elaboration strategies, with the partner countries Indonesia and 
Thailand among the top five countries. 

Control strategies 

Students who control their learning ensure that they set clear goals for themselves and monitor 
their own progress in reaching them. The PISA index of conrrol strategies derives from the following 
five items: 

STQ34a When 1 study for a mathematics test, 1 try to work out what are the most important 
parts to learn (important) . 


STQ34c When I studv mathematics, 1 make mvself check to see if 1 remember the work I have 
already done (check memory). 

STQ34d When I studv mathematics, I trv to figure out which concepts I still have not under- 
stood properly (concepts). 


STQ34J When I cannot understand something in mathematics, I alwavs search for more infor- 
mation to clarify the problem (clarfp). 

STQ341 When I studv mathematics, I start bv working out exactly what I need to learn (exactly). 


As Figure 2.6 shows, students tend to agree more strongly with these statements than was the case 
for the other two learning strategies. There is also less variation between countries than for the 
other learning strategies. 


Among the strategies students report that they use to learn mathematics examined in PISA 2003, 
the most commonly used are control strategies, along with the examples and procedures strate- 
gies of the memorisation index. In all of these cases, on average at least two-thirds of students in 
the OECD countries answer positively. There are therefore high latent correlations between the 
index of control strategies and the index of memorisation/rehearsal strategies in all countries (see 
Annex B, Table B.l, Correlations among selected index variables). 


Some countries show large differences in the use of control strategies from one school to another. 
In particular, Korea has an interquartile range that is equal to the range from the 5'^ to the 95'*’ 
percentile in Finland. In other words, the middle half of schools in Korea shows the same variability 
in the use of control strategies as the middle 90% of schools in Finland. 


These variations in the use of control strategies are particularly important because, as will be seen 
in the following chapter, the use of such strategies is linked to higher performance in Korea and 
seven other countries. 
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Rgui'e 2.5 ■ Students’ use of elaboration strategies to learn mathematics 



When I am solving mathematics problems, I often think of new ways to get the answer. 

I think of how the mathematics I have learnt can be used in everyday life. 

I trv to understand new concepts in mathematics by relating them to things I already know. 

When I am solving a mathematics problem, I often think about how the solution might be applied to other interesting questions. 
When learning mathematics, I try to relate the work to things I have learnt in other subjects. 
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Note: Countries are ranked in descending order of variation among the middle 50% of schools in stu- 
dents’ use of elaboration strategies. 

1 . At the 5th percentile students at only 5% of schools have less of a preference for the use of elabora- 
tion strategies. Students at a school at the 95th percentile have a stronger preference for the use of 
elaboration strategies than students in 95% of the other schools. 

2. Response rate too low to ensure comparability. 

Source: OECD PISA 2003 Database. 
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FiguJ-e 2.6 ■ Students’ use of control strategies to learn mathematics 



When 1 study for a mathematics test, I trv to work out what are the most important parts to learn. 

When I study mathematics, 1 make mvself check to see if I remember the work I have already done. 

When I study mathematics, I try to figure out which concepts I still have not understood properly. 

When 1 cannot understand something in mathematics, 1 always search for more information to clarify the problem. 
When 1 study mathematics, I start by working out exactly what I need to learn. 
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Variation in students’ use of control strategic 
among schools within each country 



jth 25th 


75th 95th 


Note: Countries are ranked in descending order of variation among tlie middle 50% of schools in 
students’ use of control strategies. 

1 . At the 5th percentile students at only 5% of schools have less of a preference for the use of con- 
trol strategies. Students at a school at the 95th percentile have a stronger preference for the use 
of control strategies than students in 95% of the other schools. 

2. Response rate too low to ensure comparability. 

Source: OECD PISA 2003 Database. 
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Preference for competitive learning situations 


The report classifies a second set of questions into two indices representing preference for competi- 
tive and for co-operative learning situations. These are not mutuallv exclusive, as a student mav 
want to perform well, but still enjoy working together with his or her peers. Indeed, the results 
for several countries suggest that these learning preferences mav be complementarv rather than 
conflicting (OECD average latent correlation is 0.35; see Table B.l). 


The items comprising the index oj competitive learning are: 


STQ37a 

STQ37c 

STQ37e 

STQ37g 

STQ37] 


I would like to be the best in mv class in mathematics (best). 

I trv verv hard in mathematics because I want to do better in the exams than others 
(exams). 

I make a real effort in mathematics because I want to be one of the best ((^ort). 

In mathematics I alwavs trv to do better than the other students in mv class (do better). 
I do mv best work in mathematics when I trv to do better than others (best work). 


Figure 2.7 shows the percentage of students agreeing or strongly agreeing to each of these items and 
gives the distributions across schools on the index. Here there is a wide range across countries in 
levels of agreement to the individual items, although, as discussed above, this could reflect cultural 
bias in response. As for earlier items, students in Mexico, Turkev and the partner countrv Tunisia 
show high percentages of agreement. The United States is relativelv high on this index, as are the 
partner countries Brazil and Indonesia, Among the countries whose students performed the best 
in mathematics in PISA 2003, students in Hungary, the Netherlands, Japan, Switzerland, Austria, 
Belgium and Finland tend to report being less competitive on average compared to other countries. 


Within countries, students who compete with their peers tend to do better in PISA, as is shown 
in Chapter 3. However, in some countries, there is considerably less of an ethos of competition in 
some schools than in others. Students’ reports of preference for competitive learning situations varv 
most among schools in Austria, Korea and Italv and the partner countrv Liechtenstein. In fact, all 
students in the middle 50% of schools in Austria report a preference below the OECD average for 
competitive learning situations (Figure 2.7). 


Preference for co-operative learning situations 

The items comprising the PISA index of co-operative learning are: 


STQ37b In mathematics I enjov working with other students in groups (^roup). 

STQ37d When we work on a project in mathematics, I think that it is a good idea to combine 
the ideas of all the students in a group (project). 


STQ37f I do mv best work in mathematics when I work with other students (other students). 
STQ37h In mathematics I enjov helping others to work well in a group (helpinf. 

STQ37i In mathematics I learn most when I work with other students in mv class (learn most). 
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Figut-e 2.7 ■ Students’ preference for competitive learning situations 



I would like to be the best in mv class in mathematics, 

II 1 trv verv hard in mathematics because I want to do better in the exams than others. 
1 make a real effort in mathematics because 1 want to be one of the best. 

In mathematics 1 always try to do better than the other students in my cla.ss. 

18B I do mv best work in mathematics when 1 trv to do better than others. 
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Variation in students’ preference for competitive learning 
situations among schools within each country ' 



Note: Countries are ranked in descending order of variation among the middle 50% of schools in stu- 
dents’ preference for competitive learning situations. 

1 . At the 5th percentile students at only 5% of schools have less of a preference for the use of competitive 
learning situations. Students at a school at the 95th percentile have a stronger preference for the use 
of competitive learning situations than students in 95% of the other schools. 

2. Response rate too low to ensure comparability. 

Source: OECD PISA 2003 Database. 
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Results for these items and for the index co-operative learning appear in Figure 2.8. Again, there is 
a wide response range across countries and across schools within countries and, in this case, the 
previous analysis of PISA 2000 shows that these questions are interpreted similarly across different 
cultures. 

In terms of percentage agreement, support for co-operative learning is generally higher than that for 
competitive learning. Students in some countries — such as the United States, as well as in the part- 
ner countries Brazil and Tunisia — score relatively highly on both indices, while students in Japan, 
for example, report comparatively low preference for both learning situations. In other countries, 
there are clear indications of differences in preference for these two learning situations. For exam- 
ple, students in Korea, Iceland, Mexico and Turkey report stronger preference for competitive than 
co-operative learning situations, while students in Switzerland and Portugal report stronger prefer- 
ence for co-operative learning situations. Plowever, only in Switzerland do there seem to be two 
distinct groups of students reporting preference for either one or the other of the learning situations 
(there is verv weak correlation between the two indices, 0.09). In general, the results indicate that 
some students report preferences for both learning situations with positive latent correlations of at 
least 0.20 between the two indices in 21 of the OECD countries (Table B.l). 

These results, combined with those for memorisation, elaboration and control, suggest that learn- 
ing strategies mav be relatively undifferentiated. This issue requires further investigation to deter- 
mine if the results obtained are a function of response bias or whether these various strategies are, 
indeed, complementary. For the purpose of further analysis, both because of the theoretical and 
policy interest of these indices and because the models used allow the effects of each index to be 
examined while accounting for other factors, the report retains the indices as defined. 

TEACHING STRATEGIES AND CLIMATE 

Central to the effectiveness of teaching and learning is the actual manner in which teaching takes 
place: both the teaching methods employed and the atmosphere in the classroom. Since these two 
aspects interact, the report considers teaching strategies and climate together. 

As noted earlier, there are limits to the amount of detail on teaching strategies that can be gathered 
in a broad survey, especially in the absence of a teacher questionnaire. Nevertheless, a number of 
items connected with teaching strategies appear on the PISA 2003 school and student question- 
naires. The school questionnaire contains items on staff consensus about mathematics teaching, 
staff preference for traditional versus new teaching methods, consensus on goals, teacher morale, 
pride and enthusiasm, teacher expectations of students, assessment practices, student grouping and 
enrichment, and remedial mathematics activities. The student questionnaire contains a set of items 
on the frequency of occurrence of specific behaviours and events in their mathematics lessons. 
Students’ answers form the basis of two indices: the index oj teacher support and the index oj disciplinarj 
climate. A further set of items gathers students’ views on how well students and teachers get along in 
their school in general. The answers combine to form the index of student-teacher relations. 

Note that although strategies and climate are closely related, they have a different significance in the 
analysis in this report. The teaching strategies described here do not appear in the model presented 
in Chapter 3. Thev were omitted because these strategies have either low correlations with achieve- 
ment or only small effects, which may be a result of the indirect wav thev are reported, that is, via 
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Figuhe 2.8 ■ Students’ preference for co-operative learning situations 



In mathematics I enjoy working with other students in groups, 

When we work on a project in mathematics, i think that it is a good idea to combine the ideas 
of all the students in a group. 

I do mv best work in mathematics when I work with other students. 

In mathematics I enjoy helping others to work well in a group, 

In mathematics I learn most when I work with other students in my class. 
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Variation in students’ preference for co-operative learning 
situations among schools within each country 



Median 


5th 25th 


75th 95th 


Note: Countries are ranked in descending order of variation in students’ preference for co-operative 
learning situations between schools at the 25th and 75th percentiles. 

1. At the 5th percentile students at only 5% of schools have less of a preference for the use of co- 
operative learning situations. Students at a school at the 95th percentile have a stronger prefer- 
ence for the use of co-operative learning situations than students in 95% of the other schools. 

2. Response rate too low to ensure comparability. 

Source: OECD PISA 2003 Database. 
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school principals rather than bv individual teachers. Thus, the responses do not provide data about 
individual students’ experience of instruction, but onlv about the perceptions of school principals. 
However, student descriptions of classroom climate and of student-teacher relations give informa- 
tion about individual students’ experiences of the context in which teaching takes place. This infor- 
mation can be compared to each student’s performance in mathematics; thus, these climate factors 
do appear in the model presented in Chapter 3. 


Teacher consensus on key school policies 

Traditional versus new ways of mathematics teaching 

PISA 2003 asks school principals a set of questions to gauge the extent to which there are consistent 
and shared (academic) goals in the teaching of mathematics within their schools. One possible factor 
associated with effective departments or schools is a high degree of consensus about kev school poli- 
cies. In the first of three item sets, school principals report on teacher support for innovative versus 
traditional teaching practices in their school. On average in the OECD countries: 


School principals report: 

Percentage of students in such schools 

Mathematics teachers are interested in trving new methods and 
teaching practices, 

83% 

There is a preference among mathematics teachers to stay with 
well-known methods and practices. 

60% 

There are frequent disagreements between “innovative” and 
“traditional” mathematics teachers, 

22% 


The percentages of students in each countrv whose school principals agree with these statements 
appear in Table A.7.^ There is strong agreement in most countries that teachers are interested in 
trying new methods and practices: 80% or more students in 19 of the OECD countries and in all 
of the partner countries arc in schools where the principal agrees with this proposition. School 
principals in the Netherlands and Japan are least likelv to report this: onlv 59% (the Netherlands) 
and 63% (Japan) of students are in schools whose principal reports teachers’ interest in new meth- 
ods and practices. There is considerablv more variation across countries on the question of teacher 
preference for traditional methods and practices. For example, among OECD countries, onlv in 
Hungarv, the Slovak Republic, Turkev, Luxembourg and Italv are 80% or more of students in 
schools where the principal agrees this is the case. Fewer than 50% of students are in such schools 
in nine OECD countries and two partner countries. While school principals in several countries — 
notablv Hungarv and the Slovak Republic, as well as the partner economies Hong Kong-China, the 
Russian Federation, Thailand and Tunisia — report high agreement on both propositions, the coun- 
trv-level correlation between the two statements is close to zero. Nevertheless, the within-countrv 
correlations are generally negative, indicating that school principals tend to attribute only one of 
these methods to their teachers. In general, principals report that within their schools, mathematics 
teachers with different approaches work well together. In 19 OECD countries and in six partner 
countries, fewer than 25% of students are in schools where principals report frequent disagree- 
ments between innovative and traditional mathematics teachers. However, around 50% of students 
in Mexico and the partner countrv Indonesia are in schools where the principal reports frequent 
disagreements between innovative and traditional teachers, and this is also the case for at least one- 
third of students in Turkev, Portugal and Belgium and the partner countries Uruguav and Brazil. 
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Teacher expectations 

In the second item set that collects information on consistent and shared (academic) goals, PISA 
2003 also asks school principals their opinions on teacher expectations within their school. On 
average in the OECD countries: 


School principals report; 

Percentage of students in such schools 

There is consensus among mathematics teachers that academic 
achievement must be kept as high as possible. 

89% 

There is consensus among mathematics teachers that it is best to adapt 
academic standards to the students’ level and needs. 

71% 

There are frequent disagreements between mathematics teachers who 
consider each other to be “too demanding” or “too lax”. 

19% 


The percentages of students in each country in schools where the principal agrees with these state- 
ments appear in Table A, 8. Again, the majority of students in almost all countries are in schools whose 
principals report that there is consensus among mathematics teachers that academic standards should 
be kept as high as possible. This finding concerns at least 90% of students in 16 OECD countries and 
five partner countries, and it falls to fewer than 80% of students only in Sweden, Portugal, Japan, 
Turkey and the partner country Brazil. The range of agreement to the statement on adapting academic 
standards to the students’ level and needs is extremely wide. While in 1 1 of the OECD countries and 
nine of the partner countries, more than 80% of students are in schools whose principals agree that 
academic standards should be adapted to meet students’ levels and needs, this is the case for only 16% 
of students in Luxembourg and 23% in Germany, Again, the country-level correlation between these 
variables is close to zero. However, within most countries there is a small positive correlation, suggest- 
ing that school principals do not perceive these two kinds of expectations as conflicting. Regarding the 
statement about disagreements among mathematics teachers concerning whether or not they perceive 
their counterparts to be too demanding or too lax, school principals in most countries believe the level 
of disagreement to be low — such disagreement affects fewer than 15% of students in 14 OECD coun- 
tries. Again, more than 50% of students in Mexico and in the partner country Tunisia are in schools 
whose principals report that there are frequent disagreements among mathematics teachers concern- 
ing their expectations of students, and this also concerns at least one-third of students in Turkey, 
Luxembourg, Portugal and Italy and in Uruguay, Serbia, Brazil and Thailand. 


Goals of mathematics teaching 

The third item set asks principals to report specifically on the mathematics teaching goals in their 
schools. On average in the OECD countries: 

School principals report; Percentage of students in such schools 

There is consensus among mathematics teachers that the social and 72% 

emotional development of the student is as important as their acquisition 
of mathematical skills and knowledge in mathematics classes. 

There is consensus among mathematics teachers that the development 81% 

of students’ mathematical skills and knowledge is the most important 
objective in mathematics classes. 

There are frequent disagreements between mathematics teachers who 1 3% 

consider each other as “too focused on skill acquisition” or “too focused 
on the affective development” of the student, 
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The results for each country are presented in Table A. 9. Here, the first statement gives equal 
preference to both kinds of goals but the second gives preference to the mathematical skills and 
knowledge goal. The degree of agreement among school principals is relatively strong for both 
statements, although the mathematical skills and knowledge goal generally receives stronger support 
than the idea of equal value for both kinds of goals. In the Netherlands, Luxembourg, the United 
Kingdom and New Zealand there is stronger support for the development of mathematical skills and 
knowledge as the most important teaching objective (a difference of at least 25 percentage points 
of students) while the reverse is true in Poland. Again, most school principals in most countries do 
not encounter frequent disagreements over these priorities among teachers, although Mexico is a 
notable exception. In particular, such disagreements onlv affect a small minority of students (5% 
or fewer) in Japan, New Zealand and the United Kingdom and the partner country Liechtenstein. 


Streaming and grouping 

Streaming refers to the assignment of students to classes based on ability. Grouping refers to 
within-class arrangements that differentiate students bv ability. Streaming may thus be thought of 
as a matter of school policy or perhaps of policy at higher levels of authority. Grouping, however, 
is something that can be introduced bv individual teachers, within or outside anv broader policy 
framework. School principals answer questions about both these practices. In the case of stream- 
ing, the questions attempt to differentiate between streaming bv difficulty with the same content 
or with different content. On average in the OECD countries: 

School principals report for some or all classes: Percentage of students in such schools 

Mathematics classes studv similar content, but at different levels of 30% all classes; 37% some classes 

difficulty. 

Different classes studv different content or sets of mathematics topics 15% all classes; 37% some classes 

that have different levels of difficulty, 


The percentages of principals in each country who report that their schools practice streaming bv 
difficulty, and bv content and difficulty, in some or all classes appear in Table A. 10. While a major- 
ity of schools in most countries practice streaming bv difficulty, the actual proportions differ widely 
bv country. In the United Kingdom, New Zealand, Ireland, Norway, Spain, the United States and 
Sweden, at least 90% of students encounter streaming into different classes bv difficulty for some 
or all classes, although they Studv similar content. School principals in Australia, Canada, Poland 
and the partner economies Hong Kong-China, Latvia and the Russian Federation also report a high 
degree of streaming bv difficulty in at least some classes. Conversely, 30% or fewer students in 
Greece, the Czech Republic and Austria are in schools whose principals report that there is stream- 
ing bv difficulty in at least some classes. The pattern for streaming bv content and difficulty is 
different to that for streaming bv difficulty onlv. While there is a relatively high correlation across 
countries between streaming for content and difficulty and streaming bv content onlv for stream- 
ing in some classes, the correlation between these two variables is low for streaming in all classes. 
There are a few clear examples: school principals in Norway, Poland and Portugal report high levels 
of streaming bv difficulty onlv (for more than 70% of students) and low levels bv content combined 
with difficulty (for fewer than 25% of students). 
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With regard to within-class grouping, on average in the OECD countries: 


School principals report for some or all classes: Percentage of students in such schools 

Students are grouped bv ability within their mathematics classes. 14% all classes; 30% some classes 

In mathematics classes, teachers use a pedagogy suitable for students 40% all classes; 34% some classes 

with heterogeneous abilities (i.e. students are not grouped bv ability), 


The results for all countries appear in Table A.ll. Because there is considerable overlap in the results 
when the analvsis includes the “some classes” categorv, the report presents results both with “some 
classes” and “all classes” combined and for “all classes” only. For the combined categories, the extent 
of ability grouping in at least some classes varies across countries from 70% or more of schools in 
New Zealand, Australia, the United Kingdom, Ireland and Korea, and the partner countries, the 
Russian Federation and Latvia, to fewer than 10% in Greece and Luxembourg. There is much less 
variation in the use of homogeneous grouping under this measure. With the exception of Germanv, 
Japan, Turkev and the United Kingdom and the partner countrv Brazil, at least 60% of students are 
not grouped bv abilitv within mathematics classes. 

At first glance, one might expect responses to these questions to show negative correlations to one 
another. However, the wording of the second question makes it possible to respond positivelv or 
negativelv to both. Although the countries reporting the lowest levels of abilitv grouping report 
high levels of teaching to heterogeneous groups, the opposite is not usually the case. The between- 
countrv correlation of these two variables is close to zero, as are most of the within-countrv cor- 
relations, a finding explained bv the results in the second two columns of Table A.ll. Although 
manv countries practice ability grouping in at least some classes, relativelv few do so in all classes. 
The United Kingdom, Australia and Ireland are exceptions, where close to 50% of schools report 
abilitv grouping for all classes. However, the majoritv of students in manv more countries are in 
classes suitable for students with heterogeneous abilities. In Norwav, Denmark and Poland, as well 
as the partner countrv Indonesia, at least 70% of students are in mathematics classes with pedagogv 
suitable for students of all abilities. This figure is at least 60% for students in Portugal, Greece and 
the partner economies Macao-China and Tunisia. 


Assessment 

For this item, principals estimate the frequencv of the use of various tvpes of assessment in their 
schools, on a scale ranging from “never” to “more than once a month”. Table A. 12 shows the per- 
centages of schools reporting the use of the different assessment tvpes more than three times a vear. 
The table also includes data on use of assessment onlv once or twice a vear. This enables information 
to be included on the use of standardised tests, because it is rare to emplov this form of assessment 
often, even where the application of standardised tests is a prominent feature of education svstems. 

It is clear from Table A. 12 that teacher tests and student assignments comprise the most frequent 
tvpes of assessments, with each of these occurring three to five times a year or more in over 80% of 
schools in almost all countries. Teacher ratings also show a high level of use in most countries (75% 
of students on average in the OECD countries attend schools where the principal reports teacher 
ratings are used at least three times a vear). Use of student portfolios occurs less often than the 
other internal forms of assessment, but with wide variation across countries. 
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Standardised tests are the least frequently used on average and show the most variation in use across 
countries. However, frequency of use is not the best indicator of the influence of standardised tests, 
which may be used to make high-stakes decisions involving students’ future education or careers. 
Table A. 12 shows that far more countries use standardised tests one to two times a vear than three 
to five times or more. Although the issue of high -stakes use is a source of considerable controversy, 
there is no measure in PISA of high-stakes use of standardised tests. In some countries, such as 
Austria and Belgium, and the partner country Uruguay, standardised tests seem relatively rare. It 
is not possible to determine from these data if standardised tests are centrally mandated. However, 
in a few countries, notably Finland, Iceland, the United States, Sweden, Korea and Norway, as well 
as partner country Latvia, there is almost universal use of standardised tests at least once a vear 
(95% of students or more). 

A few countries stand out as using most forms of assessment relatively more frequently or infre- 
quently than others. For example, Turkey emerges as a country where none of the forms is fre- 
quently in use in a majority of schools. Teacher ratings, teacher tests and student assignments are 
frequently used for the majority of students in many countries, but notably in Austria, Belgium, 
Germany, Iceland, Portugal, Spain, Sweden, the United States and the partner countries Brazil and 
Latvia, with frequent use bv around 90% or more of students. Further, in Spain and the partner 
country Brazil there is above-average use of both student portfolios and standardised tests. Use of 
student assignments is extensive as a form of assessment in all countries: the OECD average is 86% 
of students being subject to this form of assessment more than three times a vear, but in Greece, 
only 15% of students are similarly assessed. 

The second aspect of assessment measured bv the school questionnaire is the use of assessment 
results. The various purposes of assessment, and the percentages of schools using it for those pur- 
poses, appear in Table A. 13. 

By far the most common use of student assessment is for reporting to parents. More than 90% of 
schools in almost all countries use assessment for this purpose. Its use for .student retention and 
promotion is also common, except in Denmark, Iceland and Korea. In countries where social pro- 
motion is a matter of national policy, no schools should report using assessment for this purpose. 
Nevertheless, there is no wav to determine, in cases where a few schools report use for this pur- 
pose, if the data are unreliable or if a few schools are not following national policies. While the issue 
of social promotion deserves further attention from a policy perspective, the PISA questionnaires 
do not address it in more detail. 

The remaining uses of assessment are highly variable across countries. For example, use for compar- 
ison with national standards occurs in more than 80% of schools in the United States, the United 
Kingdom, New Zealand, Hungary and Iceland, but in fewer than 10% of schools in Denmark and 
Belgium, and in the partner economy Macao-China. A similar pattern exists for comparison with 
other schools. Denmark stands out in this overall picture, with only a very small number of schools 
using assessment for any purposes other than reporting to parents and curriculum improvement. 
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STUDENT PERCEPTIONS OF THE LEARNING ENVIRONMENT: OVERVIEW 



The remaining factors to consider in this section concern the degree to which students report that 
their classroom climate and their relations with teachers have characteristics likelv to be conducive 
to learning. A summary of the distribution of these factors and the extent to which they appear to 
be related to performance appears in Table 2.3. 

As will be shown further in Chapter 3, these factors are particularlv important because students who 
learn in a positive climate where thev interact well with their teachers tend to perform better in math- 
ematics. This relationship is clearest for disciplinarv climate. Factors related to teacher support and 
relations have an association with performance that is perhaps complicated bv extra support being given 
to weaker students. Nevertheless, the importance of these factors for teaching and learning is obvious. 

It is notable here that (as shown in Table 2.3) the magnitude of the variabilitv between schools is greater 
than for the learning strategies and preference factors considered earlier. The middle half of schools 
within each countrv vary on average bv at least 0.40 of a standard deviation for climate -related factors, 
compared to around 0.30 of a standard deviation for learning strategies. This result indicates that for 
climate factors, more of the variation in the experiences of individuals can be attributed to variations 
among schools. Even in a countrv like Finland, where there are below-average levels of variation in 
climate factors among schools, there is actuallv about the average variation level for learning strategies. 

Classroom climate 

The mea.surement of classroom climate uses a series of items on the student questionnaire related 
to degree of teacher interest and support for students, and elements of time use and disruption. 

Table 2.3 

Distribution of students’ experience of classroom climate and teacher-student relations, 
and the relationship of these factors with performance 


Variable 

Variabilitv within countries; 

Variabilitv within middle half of schools (interquartile range) 
Measured on index scale standardised relative to international 
standard deviation of individual learner characteristics 

Relationship with performance 
(Bivariate effect on mathemetics 
score, significant effects only) 

Classroom climate 
(a) Teacher support 

OECD average range; 0,42 standard deviations 

Highest variability: 0.61 in Austria, 0,55 in the Slovak Republic, 

0.54 in Italy and 0,60 in the partner countrv Serbia 

Lowest variabilitv: 0.22 in Korea, 0,25 in the Netherlands and 

0.19 in Macao- China and Liechtenstein 

Small positive association in 13 
countries, negative in 7. (When 
accounting for other factors, mainly 
negative: see Chapter 3.) 

Classroom climate 
(b) Disciplinary 
climate 

OECD average range: 0.50 standard deviations 
Highest variability: 0.79 in Japan, 0.76 in Austria, 0,68 in the 
Czech Republic and Hungary and 0.79 in Liechtenstein 
Lowest variability; 0.29 in Luxembourg, 0.36 to 0,38 in New 
Zealand, Greece, the Netherlands, Korea and in the partner 
countries Indonesia, Brazil, Thailand and Macao-China 

Significant positive association in 
almost all countries, (Remains when 
accounting for other factors: see 
Chapter 3.) 

Teacher-student 

relations 

OECD average range; 0.41 standard deviations 
Highest variability: 0.61 in Tunisia, 0.60 in Liechtenstein, 0.55- 
0,58 in Austria, Switzerland and in the partner countries Serbia 
and Brazil 

Lowest variabilitv; 0.32 in New Zealand, 0.33 in Portugal and 
0,31 in the partner countrv Thailand 

Positive association in 1 2 countries, 
in some cases relativelv strong; 
negative association in 11 countries, 
in all cases weak, (Positive 
associations weaker when accounting 
for other factors; see Chapter 3.) 
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These questions require response on a frequencv-of-occurrence scale ranging from “every lesson” to 
“never or hardlv ever”. The 11 items on this scale combine to form two indices: the index oj teacher 
support and the index of disciplinary climate. As with some other aspects of teaching strategies, these 
indices mav be considered as characteristic of a classroom rather than of a student. In the absence of 
a classroom identifier, the most appropriate level at which to examine these variables is the school 
level. The extent to which these indices varv across schools within a countrv is an indicator of 
school-system differentiation. However, it must be recognised that assessment of variations among 
teachers within a school is lost when the aggregation is to the school level. 

Teacher support 

The five items making up the index oJ teacher support are: 

STQ38a The teacher shows an interest in everv student’s learning (interested). 

STQ38c The teacher gives extra help when students need it (extra help). 

STQ38e The teacher helps students with their learning (helps learning). 

STQ38g The teacher continues teaching until students understand (understand) . 

STQ38J The teacher ^ives students an opportunitv to express opinions (opinions). 

Figure 2.9 shows the percentages of students reporting that these factors occur in everv lesson or 
most lessons. The box plots give the range of variation across schools in each countrv. 

A majoritv of students in almost all countries report that teacher support activities occur in all 
or most lessons. This result indicates, in absolute terms, perception of a high level of teacher .sup- 
port. There is a particularlv strong perception of teacher support in Mexico and Turkey, and in the 
partner countries Brazil and Thailand; there is a comparativelv weak perception of teacher support 
in Austria, Germanv, Japan and Luxembourg. Students in Australia, Canada, Denmark, Finland, 
Iceland, New Zealand, Portugal, Sweden and the United States all perceive a higher level of teacher 
support than the average in OECD countries. 

Within countries, differences in support across the middle 90% of schools range from just over 
half a standard deviation in Korea and the partner economv Macao-China to about one-and-a-half 
standard deviations in the Slovak Republic and the partner countrv Serbia. 

Disciplinary climate 

The index oJ disciplinary climate in mathematics lessons consists of the following five items: 

STQ38b Students don’t listen to what the teacher savs (dont listen). 

STQ38f There is noise and disorder (noise). 

STQ38h The teacher has to wait a long time for students to “quieten down” (cpner down). 
STQ38i Students cannot work well (can’t work well). 

STQ38k Students don’t start working for a long time after the lesson begins (late start). 
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Figut-e 2.9 ■ Students’ views on teacher support in their mathematics lessons 



The teacher shows an interest in every student's learning, 

The teacher gives extra help when students need it. 

The teacher helps students with their learning. 

The teacher continues teaching until the students understand. 
The teacher gives students an opportunity to express opinions. 
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Variation in students’ views on teacher support in their 
mathematics lessons among schools within each country 



5th 25th 


75th 95th 


~Note: Countries are ranked in descending order of variation of students’ views of teacher support in mathematics 
between schools at the 25th and 75th percentiles. 

1. At the 5th percentile students at only 5% of schools have a more negative view of teacher support in their math- 
ematics lessons. Students at a school at the 95th percentile have a more positive view of teacher support in their 
mathematics lessons than students in 95% of the other schools. 

2. Response rate too low to ensure comparability. 

Source: OECD PISA 2003 Database. 
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Percentage responses to the “all lessons” and “most lessons” categories on the index variable appear 
in Figure 2.10. Please note that this scale is “reverse scored” so that low levels of agreement with the 
five statements can be interpreted as representing a positive disciplinarv climate. 


The frequencv data show that students in most countries perceive their mathematics classes as 
having mainlv positive disciplinarv climates. The majoritv view of students that the behaviours 
presented in the statements occur relativelv infrequentlv, compared to the frequencies reported 
for teacher support, indicates that students are making distinctions between positive and negative 
statements about classroom climate. That is, there is less indication of response bias here than for 
the statements based on the agree/disagree scales. 


In absolute terms, the differences between countries are not particularlv large on this scale. Even 
for countries at the negative end of the index, the frequencies of occurrence of the negative behav- 
iours tend to be in the 30% to 40% range while those for countries at the positive end, the frequen- 
cies are in the range of 20%. 


The variation among schools within countries is higher here than for the teacher support vari- 
able. The narrowest distributions among schools occur in Luxembourg, New Zealand, Greece, 
the Netherlands and Korea, as well as in the partner economies Indonesia, Brazil, Thailand and 
Macao-China, while the widest occur in Japan, Austria, the Czech Republic and Hungarv and in 
the partner countrv Liechtenstein. 


Student-teacher relations 

A third index, the index of student-teacher relations, is an indicator of students’ views on their school 
climate. The items included in this index are the following, with responses on a four-point agree- 
disagree scale: 


STQ26a Students get along well with most teachers. 

STQ26b Most teachers are intere.sted in students’ well-being. 
STQ26c Most of mv teachers reallv listen to what I have to sav. 
STQ26d If I need extra help, I will receive it from my teachers. 
STQ26e Most of mv teachers treat me fairlv. 


Figure 2.11 shows the patterns of agreement with these items and the range of variation across 
schools. The level of agreement with these statements is moderate to high, with percentages in the 
50 to 80% range in most cases. The pattern across countries is quite similar to that for teacher sup- 
port, and shows a comparable range, with more than one-and-a-quarter standard deviations between 
the 5‘^ and 95‘^ percentiles in Austria, Norwav, Mexico and Germanv and the partner countries 
Tunisia, Serbia and Brazil, and more than one-and-a-half standard deviations in Switzerland. 
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Figure 2.10 ■ Students’ views on the disciplinary climate in their mathematics lessons 



Students don’t listen to what the teacher savs. 

There is noise and disorder, 

The teacher has to wait for a long time for students to “quieten down”. 

Students cannot work well. 

Students don’t start working for a long time after the lesson begins. 

Variation in students’ views on the disciplinary climate 
in their mathematics lessons among schools within each country 
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Note: Countries are ranked in descending order of variation of student views on the disciplinary 
climate in their mathematics lessons between schools at the 25th and 75th percentiles. 

1. At the 5th percentile students at only 5% of schools have a more negative view of disciplinary 
climate in their mathematics lessons. Students at a school at the 95th percentile have a more 
positive view of disciplinary climate in their mathematics lessons than students in 95% of the 
other schools. 

2. Response rate too low to ensure comparability. 

Source: OECD PISA 2003 Database. 
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Figui'e2,11 ■ Students’ views on student-teacher relations 



Students get along well with most teachers. 

Most teachers are interested in students' well-being, 
Most of mv teachers reallv listen to what I have to sav. 
If I need extra help, I will receive it from my teachers. 
Most of mv teachers treat me fairlv. 
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Variation in students’ views on student-teacher relations 
among schools within each country 
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Note: Countries are ranked in descending order of variation of student views on student-teacher 
relations between schools at the 25th and 75th percentiles. 

1 . At the 5th percentile students at only 5% of schools have a more negative view of student-teacher 
relations. Students at a school at the 95th percentile have a more positive view of student-teacher 
relations than students in 95% of the other schools. 

2. Response rate too low to ensure comparabilitv. 

Source: OECD PISA 2003 Database. 
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SUMMARY; A PROFILE OF MATHEMATICS TEACHING AND LEARNING 




Overall, the results of this analysis show a complex and widely varying picture of mathematics 
instruction both within and across participating countries. While it is almost impossible to present 
a simple summary, a qualitative profile can be developed by looking at mid-ranked countries and at 
those at the extremes of the various distributions. 

Students in participating countries spend an average of 37 weeks per vear in school. Most coun- 
tries show onlv small differences between schools in the number of weeks in the school vear. This 
evidence undoubtedly reflects either national consensus or national regulation of the school vear. 
However, in several countries the between-school differences are striking. On average, the school 
week is 24.4 hours long, again with onlv small differences between schools in most countries. 
Multiplying number of weeks in the school vear bv hours per week gives a measure of total instruc- 
tional time per vear. This measure averages close to 1 000 hours in most countries, but ranges from 
a high of over 1300 hours in the partner country Thailand to fewer than 800 hours in Mexico. 
According to this measure, the school year is more variable within countries than the number of 
school weeks would suggest. 

On average in the OECD countries, 15-vear-olds report that thev spend approximately 200 minutes 
per week, or 14% of total instructional time, on mathematics. This figure compares to averages 
of 17% of total compulsory instructional time spent on mathematics bv 9-to-ll-vear-olds and 13% 
spent bv 12-to-14-vear-olds, as reported in the 2004 OECD-INES Survey on Teachers and the 
Curriculum. 

In most countries, the profile shows that fewer than 20% of students have a tutor or participate 
in school-related classes outside school hours, and the amount of time spent on such activities is 
relatively small even for those who do participate. However, a few countries show very high propor- 
tions of students taking part in such activities. This finding is essentially unrelated to the amount 
of time spent in school. It is difficult to identify the factors that contribute to students’ and parents’ 
decisions to pursue such activities, and in particular whether such decisions relate to competi- 
tive environments, attempts to mitigate poor school performance or concern with the quality of 
schooling. It is also unclear if having a tutor or participating in out-of-class lessons relates to socio- 
economic status. However, the highest participation rates in these activities occur in a few countries 
with relatively low socio-economic levels. This evidence suggests several possibilities, including a 
strong emphasis on education as a wav to improve individual economic prospects or, conceivably, 
the availability of inexpensive education services outside regular schools. Alternatively, of course, it 
is possible that the results represent anomalies due to misunderstanding of the question or another 
form of response bias. 

According to the profile, almost all students do some homework outside school, both in mathemat- 
ics and in other subjects. On average, students spend close to six hours per week on homework, of 
which about 2.5 hours is on mathematics. Proportionally, mathematics occupies more of students’ 
homework time than of their school time, suggesting that there is greater emphasis on homework 
in mathematics than in other subject areas. There is substantial homework variation across schools 
in most countries. In some cases, the within-countrv variation is as great as the average variation 
across countries. This evidence suggests that the amount of homework completed is largely a func- 
tion of school policies. 
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Of the three meta-cognitive learning strategies, it is clear that students use elaboration and control 
strategies more than memorisation/rehearsal strategies. However, the results indicate that, among 
the memorisation/rehearsal strategies, students favour using examples and trying to learn proce- 
dures over simple “learn bv heart” memorisation. Within the elaboration cluster, learning to relate 
concepts to what is already known is more common and less variable than other strategies. Most of 
the specific strategies within the control cluster receive high support from students, with relatively 
little variation across countries. There is also relatively little variation across schools for these strat- 
egies, especially elaboration and control, suggesting that these are stable student attributes rather 
than highly influenced by the school. Memorisation and elaboration show higher than usual varia- 
tion across schools in only a small number of countries. 


In general, the profile shows students reporting stronger preferences for co-operative than for 
competitive learning situations in mathematics. In a few countries, students express strong prefer- 
ences for both learning situations, while in others there is a clear division. While these constructs 
may intuitively appear mutually exclusive, or at least negatively related, the data do not support this 
argument. 


Most school principals agree that their teachers are open to innovative teaching practices. There is 
more variation across countries in teacher support for traditional wavs of teaching. The correlations 
between these two factors within countries are negative, indicating that school staff tend to support 
either traditional or innovative methods. In most countries, there is relatively little indication of 
disagreement among staff about these approaches. 


A large majority of school principals in all countries believe that their teachers expect high academic 
standards of their students and that the development of mathematical skills and knowledge is the 
most important objective of mathematics teaching. However, there is wide variation across coun- 
tries in the degree of support for adapting standards to student abilities. Most school principals also 
report that their teachers support the proposition that social and emotional goals are as important 
as acquiring mathematics skills and knowledge. 


The profile shows that there are wide variations among countries in the degree of streaming of 
students into different mathematics classes based on ability. Streaming is particularly prevalent in 
the United Kingdom, New Zealand, Ireland, the United States, Australia and Canada. Variations 
occur among countries that otherwise have regional or cultural similarities. For example, streaming 
is prevalent in Norway and Sweden, but not in Denmark or Finland. Similarly, there is a high level 
of streaming in the partner economy Hong Kong-China but a relatively low level in Japan and in 
the partner economy Macao-China. The use of within-class grouping is much more widely variable 
than streaming. Surprisingly, manv countries that practice high degrees of streaming also have high 
levels of within-class grouping. This combination is frequent in New Zealand, Australia, the United 
Kingdom, Ireland, the United States, Sweden, the Netherlands, Canada and the partner countries, 
the Russian Federation and Latvia. 


The most frequently used methods of assessment in almost all countries are teacher tests and 
Student assignments. Teacher ratings are also often used in most countries. However, there is con- 
siderable variation among countries in the use of standardised tests and student portfolios. School 
principals in most countries report that 20 to 39 student assessments take place each year. Since 
the assessment questions were not specific to mathematics, it is not clear if this is within subjects 
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or over all subjects. The most common use of assessments is for reporting to parents. Use of assess- 
ment for student retention is also common. However, in a few countries, notably Denmark, Iceland 
and Korea, this is onlv rarelv the case. Use of assessments for comparison with national standards 
varies widelv: this is the case in more than 80% of schools in some countries and in fewer than 
10% of schools in others. Denmark stands out as rarelv using assessment for anv purpose other than 
reporting to parents. 

The profile indicates a majority of students in most countries agreeing that activities associated with 
teacher support are frequentlv used in their classrooms and that student -teacher relations are gener- 
allv positive. Most students feel that teachers take an interest in their learning, that teachers give 
them help when needed, that thev have an opportunitv to express opinions and that teachers treat 
them fairlv. There are few extremes here, suggesting that most students in most countries have a pos- 
itive view of their teachers. The smaller-than-average proportions of students who report noise and 
disruption and other disciplinarv problems reinforce this finding. However, there appears to be more 
variation across schools in the index oj disciplinarj climate in mathematics lessons than in the index oj teacher 
supporty and more between-school differences on this set of variables than for learning strategies. 

Differences that matter 

The above description seems to show, in particular, that students’ relations with their teachers and 
the disciplinarv climate are two factors associated with better performance in which variation across 
schools can be considerable. The implication of this is that a more consistentlv positive teaching envi- 
ronment can contribute to reductions in between-school differences in performance, and this is more 
obviouslv so than might be the case for other factors examined here. The problem, as noted earlier, 
is that there is a likelv interaction between disciplinarv climate and student-teacher relations on the 
one hand and socio-economic and other student background factors on the other, possiblv leading to 
a mutuallv reinforcing or mutually detrimental effect on achievement. This issue needs to be inves- 
tigated more thoroughly than is possible in this overview study and can be revisited in PISA 2012. 

However, the limited association with performance and degree of difference across schools for anv 
one element studied suggests that a combination of teaching and learning factors mav give students 
in one school an advantage over those in another. One noticeable trend in the summary tables in this 
chapter is that some countries show high levels of between-school differences across many factors, 
while others show consistentlv low levels of difference. In particular, Austria, Hungary, Italy and 
Mexico are among those countries with the widest variations in a range of factors, while Finland 
has relatively low variations on many factors. The combined impact of differences is likelv to have a 
cumulative effect on student performance. 

In interpreting the patterns presented in this profile, a central issue is the extent to which variations 
in teaching and learning practices affect students’ chances of success, and where such differences 
are most significant. In some cases variations across countries are considerable, but thev need to 
be interpreted with caution. Of greater interest is the large variation in teaching and learning fac- 
tors between schools in some countries, giving unequal chances to different students. Also, the 
relationships noted in this chapter between teaching and learning strategies and student perform- 
ance in mathematics represent simple correlations. The analysis of these relationships is refined in 
Chapter 3, using models in which the effect of a particular teaching or learning strategy is examined 
while adjusting for other variables. 
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Notes 


1 There are a few exceptions to tliis among OECD countries. In particular, in Mexico, Portugal and Turkey, fewer 
than 90% of students aged 15 are enrolled in school (OECD, 2005). 

2 Strictly speaking, teaching strategies should be thought of as characteristic of a teacher. However, in the absence 
of a teacher questionnaire, student perceptions of teaching strategies have been aggregated to the school level 
and considered representative of the school. In addition, some of the time variables, such as instructional weeks 
per year and instructional hours per week, are better conceptualised as school-level than as student-level factors. 
Nevertheless, in some countries, the existence of streaming and the fact that PISA students may be found in more 
than one grade implies that within-school differences in time allocation and use may also be important. Such dif- 
ferences are neither characteristic of schools nor of individual students but of sub-units within schools, and hence 
are not examined here. 

5 The graphs in this chapter have been arranged in descending order of the range from the 25th to the 75th percen- 
tile. This order is designed to allow easy inspection of differences between schools within countries. 

4 Education at a GJance: OECD Indicators 2005 (OECD, 2005) shows Mexico’s average total instructional hours as 
slightly longer than the OECD average. 

5 Caution is required here as it is possible that students in some countries are giving what they perceive to be 
socially desirable responses. 

6 Results based on the school questionnaire are presented as tables rather than graphs because multiple series bar 
graphs for a large number of countries are difficult to read and interpret. In this situation the tables are more 
compact than comparable graphs. 
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This chapter Jjrst outlines the approach taken to develop an analytical Jramework 
reaching and learning strategies, and then considers the actual (^octs oj background 
Jactors and teaching and learning Jactors in PISA 2003, with separate JindingsJor each 
country. Teaching and learning strategies do not take place in a vacuum. Rather, various 
background characteristics oJ students and schools create a context that can prc^oundly 
ii^uence teaching and learning processes and outcomes. These backgroundjactors retpiire 
examination alongside the teaching and learning Jactors, whose predictive power is the 
main subject oJ investigation in this chapter. 
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INTRODUCTION 


The extent to which teaching and learning enable students to acquire knowledge and skills is central 
to the success of school svstems. But can measurable features of teaching and learning activity be 
linked with testable student outcomes? In principle, PISA provides the tools to make such connec- 
tions, both bv measuring a range of characteristics of teaching and learning as reported bv students 
and school principals and bv testing student performance. However, drawing out links between 
the two is an imprecise science, not least because the knowledge and skills a student mav have at 
age 15 are the product of learning over manv vears, both inside and outside school, whereas PISA 
is onlv able to look at conditions that 15 -year-olds are experiencing in their schools at the time of 
the survey. 


Recognising these limitations, this report uses a model designed to consider the extent to which 
certain features of teaching and learning can help predict performance in mathematics in the PISA 
assessment. This model acknowledges that teaching and learning do not take place in a vacuum. 
Various background characteristics of students and schools create a context that can profoundlv 
influence the teaching and learning process and its outcomes. These characteristics include socio- 
economic background, student attitudes to school and mathematics, student levels of motivation, 
their perceptions of their own capabilitv, and structural characteristics of schools such as school 
size. Such factors can be regarded as the antecedents of teaching and learning because thev are not, 
for the most part, under the control of those who manage schools. These background factors bear 
examination alongside the teaching and learning factors whose predictive power is the main subject 
of investigation in this chapter. 

The chapter outlines the approach taken in developing an analvtical model of teaching and learning, 
and then considers the actual effects of background factors and of teaching and learning factors in 
PISA 2003.' 


An analytical model of the effect of teaching and learning strategies on mathematics 
achievement 

The discussion that follows uses an analvtical model designed to determine to what extent learn- 
ing strategies and teaching strategies are associated with stronger mathematics performance, after 
accounting for other characteristics of students and schools. Thus, mathematics achievement is the 
educational outcome, student learning strategies and teaching strategies are its main predictors and 
a wide varietv of other characteristics are treated as antecedents to learning. These last character- 
istics are controlled for in the analvtical models, so that the teaching and learning effects can be 
more clearlv seen. 

The measures of teaching and learning that are considered here can be thought of as those that 
contribute to the efficiencv or effectiveness with which learning takes place. The measures of ante- 
cedents to learning mainlv cover factors that appear in other PISA reports, and in the literature, as 
being significantlv related to achievement. Although it is impossible to establish the causal direction 
of effects in analvtical models built on correlational data, measures other than teaching and learn- 
ing strategies are modelled here as having influences on achievement that are independent of the 
antecedent variables. 
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The analytical model is a multi-level one which looks at the performance and characteristics both 
of individual students and of groups of students within schools. The grouping of students within 
schools in the survey makes it possible to examine variations across schools as well as among students. 
The analytical model first provides an estimate of the proportions of variability in achievement as 
accounted for bv school differences on the one hand and bv student differences within schools on the 
other. Once these proportions have been established, each measure of teaching and learning can be 
added in turn to the analytical model and its contribution to achievement estimated when account 
is made for all the other variables. The report expresses this contribution as an effect (regression 
coefficient), which may be interpreted as the change in mathematics achievement attributable to a 
one-unit change in the chosen measure or predictor in the analytical model. The theoretical approach 
outlined in Chapter 1 and the general logic of education production functions, which treats context 
measures essentially as antecedents to teaching and learning and hence as factors to be accounted 
for in studies of teaching and learning strategies, determine the overall structure of the analytical 
model. Measures of context in this analysis include students’ socio-economic background, students’ 
self-beliefs as mathematics learners and students’ general attitudes towards school. 


In this type of analytical model, a third level of analysis could potentially be added: that at coun- 
try level, in addition to student and school levels. However, the analysis of three-level models 
is complex, and the relatively small number of countries surveyed precludes the use of manv 
countrv-level variables. In addition, there are indications that students in different countries 
may interpret questionnaire items differently, making it difficult to treat some of the measures 
as a single scale across countries. For these reasons, the report presents results for each country 
separately. While the report does not build cross-countrv comparisons into the modelling, it is 
useful nevertheless to examine whether the effects of particular teaching and learning strategies 
are universal or country-specific. This question is analysed bv examining differences in the size 
of the model coefficients across countries. 


The PISA database contains manv measures that can be analysed to investigate the effects of teach- 
ing and learning strategies (see Chapter 2) The choice of variables included in the model and the 
choice of results presented in this chapter was guided bv an in-depth exploratory analysis of a wide 
range of variables in the PISA 2003 database." The final set of measures included in the analytical 
model are those judged to give the best overall predictive power of student achievement with mini- 
mal redundancy among the predictors. This exercise has led to the exclusion of several measures 
related to time and to school principals’ perceptions of teaching strategies, as these have shown 
essentially no separate effects when modelled as predictors of achievement. 


REPORTING THE RESULTS 

To avoid undue complexity the reported results concentrate on two types of effects relating the 
measures of teaching and learning strategies to PISA mathematics performance. The first tvpe is a 
bivariate regression coefficient representing the direct or absolute association of a particular teach- 
ing or learning strategy variable with performance, as already presented in Chapter 2. This coeffi- 
cient shows how strongly each measure is associated with performance, before accounting for other 
factors. The second tvpe is a multi-level, multivariate regression coefficient and shows the unique 
effect of a single variable, after accounting for other factors in the teaching and learning analytical 
model (see Box 3.1). This chapter reports on the unique effects for each factor and reminds readers 
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of the observed associations with performance already found for each factor. Comparing the two 
sets of coefficients for all countries presents a picture of the extent to which other factors included 
in the analytical model have mediated the effect of the factor under examination.^ 

A complete breakdown of the effects for each measure included in the analytical model for each 
country appears in Annex C, Multilevel Model, Table C.l, Multivariate regression coefficients and 
standard errors. Table C.2 presents the bivariate regression coefficients and standard errors. For 
those interested in a complete profile for a specific country or group of countries, the tables can be 
used to construct within-countrv figures across all of the factors analysed, similar to the across- 
countrv figures presented in this chapter. 

Box 3.1 ■ Interpreting the effects of regression coefficients 

The figures and tables in this chapter are based on regression coefficients designed to show 
the effect on mathematics achievement of a one-unit change in each of the independent 
measures or predictors included in the analytical model. 

A one-unit change indicates a difference of one standard deviation in each measure. In some 
cases, the measure of interest is an index and a difference of one standard deviation equals 
an increase of one unit on the index. For each index, values are standardised so that the 
mean value is zero and one unit is equal to one standard deviation. For example, on an index 
showing the strength of the disciplinary climate as reported bv students in answering a range 
ol questions, an average-strength disciplinary climate is represented as zero. The index is 
constructed so that about two-thirds of students internationally report a disciplinary climate in 
the range +1 to -1, i.e. within one standard deviation of the mean. A regression coefficient of, 
sav, 10 indicates that a one -point difference on this scale is associated with a difference of 10 
score points on the PISA mathematics scale. Looked at in another wav this would mean that, 
taking the middle two -thirds of students ranked bv how strongly they rate the disciplinary 
climate of their schools, those with the strongest disciplinary climate would have predicted 
mathematics scores 20 points ahead of those with the weakest disciplinary climate (because 
they would be separated bv two standard deviations on the disciplinary climate scale). 

In most figures and tables, both a bivariate coefficient (absolute or observed effect) and a full-model 
coefficient (relative or unique effect) are shown for each country. The bivariate effect represents 
the effect on mathematics achievement of one unit change in the variable of interest when this 
variable is considered alone. This effect is often referred to as the observed association with 
performance. The full-model effect is the coefficient obtained when all measures are included in 
the model. Therefore, it represents the effect on mathematics achievement of a one-unit change 
in the measure of interest, accounting for all of the other measures included in the model. This 
relative or unique effect is shown for each country in graphical format, with countries ordered 
bv the size of the effect. Statistically significant effects are shown as blue bars and non-significant 
effects as white outline bars. In each case, the accompanying table gives some further information 
to aid in interpreting the effects. A comparison of the bivariate coefficient with the full model 
coefficient gives a sense of the degree to which other measures included in the model exert 
mediating effects on the measure of interest’s association with performance. In almost all cases, 
the full-model effect is smaller than the bivariate effect because of these mediating influences. 
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Box 3.1 ■ Interpreting the effects of regression coefficients (continued) 


It is important to note that, although the figures have been ordered bv size of effects, these 
figures should not be interpreted as a comparative ranking of countries, as is the case for the 
achievement results. Statistical significance of the effects shown refers to whether the coefficient 
is significantlv different from zero, not whether effects in different countries are statisticallv 
significant when compared with each other. Where the strength of an effect is shown as greater 
in one countrv than another, this difference is not alwavs statisticallv significant. In some cases, 
comments are made in the text about comparative effects: these applv mainlv to countries at 
the extremes of the distribution or to patterns across countries with similar characteristics. All 
differences large enough to warrant comment are statisticallv significant. 

Including a large number of measures in regression models makes calculations technicallv 
difficult. One problem is that the effects of occasional missing data are more significant 
overall than when fewer factors are considered. In the analvsis conducted in this report, 
multiple imputation techniques were used to deal with missing data. 


HOW MUCH PERFORMANCE VARIATION IS DUE TO SCHOOL DIFFERENCES AND 
HOW DO A RANGE OF FACTORS CONTRIBUTE TO THIS VARIATION? 

From the results presented in Chapter 2, it is clear that the amount of variation among schools in 
some of the factors analvsed here differs widelv from one countrv to another. Some countries seem to 
have relatively homogeneous school systems, while in others schools have wide variations in a number 
of factors. PISA results have shown strong differences with regard to the socio-economic composi- 
tion of schools: some countries have schools that are highlv differentiated in terms of students’ back- 
grounds and other countries have relativelv small differences in socio-economic composition between 
different schools (OECD, 2004). To what extent do schools differ in teaching and learning strategies? 

The analvsis in this report partitions the total variation in students’ performance in mathematics 
into between-student and between-school components. It is instructive to examine these compo- 
nents in terms of the impact on overall performance of differences between schools and as a precur- 
sor to the more detailed analvsis of the effects of selected student and school factors on achievement. 

Figure 3.1 shows the total variance in mathematics performance accounted for bv the teaching and 
learning analvtical model for each countrv, and the amount of this variance attributable to differences 
between students and schools. In this graph, the total length of the bars gives the total variance, with 
the two segments showing how much of this variance is attributable to differences between schools 
(left segment) and variation within schools (right segment). Generallv speaking, countries that have 
high total variation in achievement also tend to have high between-school variation, and vice versa. 
That is, highlv differentiated school svstems tend to be associated with high variations in achievement 
while relativelv homogeneous school svstems tend to be associated with smaller overall variations in 
achievement. There are notable exceptions to this, however. For example, Sweden has moderate total 
variation in performance but low variation between schools, while the Netherlands has similar total 
variation in performance to Sweden but much greater variation between schools. 
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Figure 3.1 ■ Total student and school variance accounted for by the model 
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Finland, Ireland, Canada and Spain have among the smallest total variation in performance and the 
smallest variation between schools. In the cases of Canada and Finland, this finding also combines 
with high average performance in mathematics, showing that imiformitv does not necessarilv come 
at the expense of overall performance. Conversely, some high-achieving countries, notablv Japan 
and the partner economv Hong Kong-China, have both high variation overall and between schools. 


The results from the analvtical model are not dependent on the order of entrv of the different factors 
analysed; nevertheless, an important indicator of the predictive power of the model is the proportion 
of school and student variance accounted for as one adds additional measures or factors. When built in 
stages, the analvtical model unfolds with one or more factors added at each stage and with the order 
of addition chosen on a priori grounds. Stable student factors or measures considered as precursors of 
learning strategies enter before the measures of more specific learning strategies. For example, the 
three measures of students’ socio-economic background enter at the first stage in order to account 
for the effects of socio-economic background when examining learning strategies. Student attitudes 
towards school, students’ motivation to learn mathematics and their levels of anxietv in learning math- 
ematics, as well as students’ self-beliefs as mathematics learners enter next, in that order, because these 
factors were judged to be predictors of students’ use of learning strategies. Student learning strategies 
enter next, on the assumption that student factors are more stable and hence require treatment as 
antecedent to teaching strategies. Finally, teaching strategies enter, along with two school-level factors, 
school size and school level socioeconomic status, considered as related to teaching strategies. 


The analvtical model examines manv different student and school factors. As such, the predictive 
power of an individual measure is likelv to be reduced due to the impact of mediating effects, as 
alreadv described. While this might suggest that the effects of teaching and learning strategies are 
underestimated or are artefacts of the analvtical model chosen, it is important to recognise that this 
model was established on a priori grounds, based on a hvpothesised causal sequence. The effects of 
teaching and learning strategies thus appear as unique effects, accounting for all factors considered 
to be antecedents.'^ In anv event, comparison of the bivariate and analvtical model coefficients pro- 
vides a sense of the impact of other factors in the model on the variables of interest. 


Figure 3.2 shows the average proportions of school and student variance accounted for bv the model. 
(A complete breakdown of these proportions bv countrv appears in Table C.3, Variance explained bv 
the multivariate multilevel model on teaching and learning.) As can be seen, the model is more effec- 
tive in accounting for school variance than for student variance. The greatest incremental contribu- 
tions to the variance accounted for occur when the measures of motivation to learn mathematics and 
self-belief as mathematics learners are included, and also with the inclusion of the socio-economic 
composition of the school. Nevertheless, there are significant contributions, especiallv to school vari- 
ance, on entering some of the measures of student learning strategies and teaching strategies. 


While the report presents this partitioning of variance in terms of graduallv adding more factors 
to the model, in reporting the final model results each factor is considered in relation to all other 
factors in the model, demonstrating both the observed (bivariate) association with performance 
and the unique effects after taking account of other factors. The analvsis looks in turn at the ante- 
cedents to learning and at the predictors. The methodologv for calculating the effect of these two 
groups of factors is the same, but the second set are of greatest interest in this report; the first set 
are reported for context. 
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Figure 5.2 ■ Average proportions of student and school variance 
accounted for by the model 



Model Stage 

1 Parents’ highest occupational status, parents’ highest level of education, number of books in the home 

2 Students’ attitudes towards school and students’ sense of belonging at school 

3 Students’ interest in and enjovment of mathematics and students’ instrumental motivation in learning 
mathematics 

4 Students’ anxiety in mathematics 

5 Students’ self-efficacv in mathematics and students’ self-concept in mathematics 

6 Hours per week of total homework, hours per week of mathematics homework, tutoring in mathematics, 
out-of-school classes 

7 Memorisation/rehearsal strategies, elaboration strategies, control strategies 

8 Preference for competitive learning situtations, preference for co-operative learning situtations 

9 Teacher support, student-teacher relations 

10 School average of the highest international socio-economic index of occupational status (HISEI) of both parents 

11 School size 

12 School average disciplinary climate 
Source: OECD PISA 2003 Database. 


THE MEASURED EFFECTS OF ANTECEDENTS TO LEARNING INCLUDED IN THE 
ANALYTICAL MODEL 

Students' socio-economic background 

The report uses three measures of students’ socio-economic background. These measures are the high- 
est occupational status of parents (HISEI), the highest educational level of parents (HISCED) and the 
number of books in the home. The report uses these measures in preference to the composite index 
of socio-economic background (a variable called ESCS) found in the PISA data file because thev are 
straightforward and easilv understandable variables, and because exploratorv analvsis reveals them 
to be better predictors of achievement than most other variables that make up the composite index. 

Figure 3.3 shows the effects of the highest occupational status of parents. This socio-economic meas- 
ure is positivelv associated with mathematics performance in all countries. In Japan and in the partner 
economv Macao-China the relationship is non-significant. Even after accounting for other teaching and 
learning factors, there remains a positive association in 31 countries, although the other factors greatlv 
reduce the effect. For example, the effect decreases bv at least two-thirds in the Slovak Republic, 
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Spain, the Russian Federation, Norway, Poland and Sweden. In most countries, this index and the 
other two measures of students’ socio-economic background account for substantially more of the 
yariation between schools than between students. This finding indicates that there is a considerable 
school-level effect independent of variations in students’ socio-economic backgrounds within schools. 


The second measure of students’ socio-economic background is the level of education of the parents 
(Figure 3.4). PISA asked students to indicate the educational level of both parents; the index used 
here is the highest level of either parent. This measure, like the highest occupational status of parents, 
shows a positive association with mathematics performance for almost all countries. The exceptions 


Figute 5.5 ■ Parents’ highest occupational status (HISEl) and mathematics performance 


Bivariate Multivariate 



Mean 

Effect 

S.E. 

Effect 

S.E. 

Belgium 

50.59 

17.9 

(1.13) 

10.5 

(1.26) 

Poland 

44.96 

32.2 

(1.74) 

10.3 

(1.77) 

Australia 

52.59 

19.8 

(1.30) 

9.2 

(1.19) 

Norway 

54.63 

28.4 

(1.75) 

9.1 

(1.51) 

Denmark 

49.26 

25.4 

(1.75) 

8.9 

(1.60) 

Sweden 

50.64 

27.3 

(1.79) 

8.8 

(1.47) 

United States 

54.55 

22.2 

(1.26) 

8.5 

(1.15) 

Portugal 

43.10 

22.6 

(1.40) 

8.5 

(1.57) 

Switzerland 

49.30 

18.6 

(1.54) 

8.3 

(1.38) 

Brazil 

40.12 

13.1 

(2.26) 

8.3 

(2.07) 

Ireland 

48.34 

22.2 

(1.73) 

8.2 

(1.42) 

Finland 

50.23 

21.7 

(1.28) 

8.1 

(1.07) 

Canada 

52.58 

18.1 

(1.06) 

8.1 

(0.96) 

New Zealand 

51.46 

23.1 

(1.44) 

7.7 

(1.27) 

Latvia 

50.28 

15.6 

(1.82) 

7.6 

(1.45) 

Macao-China 

39.42 

6.1 

(4.10) 

6.7 

(3.91) 

Luxembourg 

48.17 

15.3 

(1.42) 

6.6 

(1.69) 

lunisia 

37.50 

10.5 

(1.39) 

6.6 

(1.52) 

Uruguay 

46.15 

13.0 

(1.36) 

6.3 

(1.59) 

Thailand 

36.01 

9.7 

(1.39) 

5.7 

(1.67) 

Netherlands 

51.26 

9.5 

(1.35) 

5.3 

(1.24) 

Czech Republic 

50.05 

15.3 

(1.59) 

5.2 

(1.63) 

Italy 

46.83 

7.3 

(1.11) 

4.6 

(1.02) 

Germany 

49.33 

13.0 

(1.52) 

4.3 

(1.39) 

Hong Kong-China 

41.13 

5.7 

(1.76) 

4.2 

(1.69) 

Hungary 

48.58 

10. 1 

(1.62) 

4.0 

(1.57) 

Russian Fed. 

49.86 

12.8 

(1.51) 

3.8 

(1.49) 

Serbia 

48.07 

11.1 

(1.43) 

3.7 

(1.14) 

Spain 

44.29 

15.8 

(1.25) 

3.4 

(1.14) 

Slovak Republic 

48.79 

14.5 

(1.25) 

3.2 

(1.24) 

Greece 

46.94 

12.2 

(1.66) 

2.3 

(1.73) 

Mexico 

40.12 

4.8 

(0.96) 

2.2 

(0.88) 

Turkey 

41.57 

6.4 

(1.60) 

2.1 

(1.52) 

Austria 

47.06 

7.0 

(1.21) 

2.0 

(1.35) 

Iceland 

53.72 

12.9 

(1.50) 

2.0 

(1.46) 

Korea 

46.32 

7.5 

(1.52) 

1.4 

(1.25) 

Japan 

49.98 

2.0 

(1.47) 

0.0 

(1.28) 

United Kingdom 

49.65 

21.8 

(1.38) 

9.5 

(1.27) 


Score point difference 
per unit change in total homework 



-10 0 10 


1 . Response rate too low to ensure comparability. Statistically significant score point 

Source: OECD PISA 2003 Database. differences are marked in a darker tone. 
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are Austria and the partner economies Brazil, Hong Kong-China, Indonesia and Macao-China. (In 
these countries, the relationship is non-significant). However, when included in the analytical model 
with all other factors, this positive association with performance remains in onlv Denmark, Iceland 
and Ireland and becomes negative in Austria, Italy and the partner countries Tunisia and Brazil. 


The third measure of students’ home background is the students’ estimate of the number of books in the 
home.^ Figure 3.5 gives the results for books in the home and — unlike for parents’ education — there is 


Figui'S 5.4- ■ Parents’ highest educational level (HISCED) and mathematics performance 


Bivariate 

Multivariate 

Score point difference per unit change 
in total homework 


Mean 

Effect 

S.E. 

Effect 

S.E. 

Denmark 

4.47 

25.8 

(2.02) 

6.4 

(1.76) 



Iceland 

4.28 

20.1 

(1.79) 

6.2 

(1.86) 



Poland 

4.09 

4.23 

35.9 

18.9 

(2.36) 

(1.59) 

3.5 

3.4 

(1.96) 

(1.43) 



Czech Republic 

4.36 

17.8 

(2.09) 

2.6 

(2.16) 



Slovak Republic 

4.32 

18.2 

(2.16) 

2.5 

(1.50) 



New Zealand 

4.2S 

20.9 

(1.93) 

2.5 

(1.71) 



Germany 

4.05 

11.4 

(1.34) 

2.1 

(1.36) 



Finland 

4.80 

19.4 

(1.52) 

1.8 

(1.30) 



Russian Fed. 

4.86 

15.8 

(1.92) 

1.5 

(2.20) 



Switzerland 

3.88 

13.6 

(1.34) 

1.2 

(1.10) 


3 

Canada 

4.84 

18.5 

(1.49) 

1.0 

(1.48) 


a 

Hungary 

4.22 

13.1 

(1.66) 

0.7 

(1.35) 


a 

Spain 

3.87 

10.2 

(0.86) 

0.7 

(0.98) 


1 

Turkey 

2.84 

6.1 

(1.39) 

0.6 

(1.23) 


1 

Greece 

4.12 

10.8 

(1.45) 

0.4 

(1.34) 


1 

Latvia 

4.90 

18.9 

(3.95) 

0.1 

(2.25) 



Mexico 

3.15 

2.0 

(0.99) 

0.0 

(0.97) 



United States 

4.67 

20.0 

(1.90) 

0.0 

(1.60) 



Korea 

4.04 

6.3 

(1.20) 

-0.2 

(1.06) 



Thailand 

2.55 

5.4 

(1.21) 

-0.3 

(1.36) 



Luxembourg 

4.09 

8.5 

(1.08) 

-0.5 

(1.34) 

1 


Uruguay 

3.83 

7.3 

(1.47) 

-0.5 

(1.54) 

C 


Japan 

4.77 

3.5 

(1.64) 

-0.6 

(1.38) 

C 


Macao-China 

2.63 

2.4 

(3.23) 

-0.6 

(2.85) 

1 


Belgium 

4.64 

11.0 

(1.25) 

-0.7 

(1.15) 

■ 


Australia 

4.62 

12.4 

(1.49) 

-0.8 

(1.25) 

■ 


Sweden 

4.67 

15.9 

(1.75) 

-1.0 

(1.54) 

■ 


Netherlands 

4.56 

4.3 

(1.21) 

-1.4 

(1.13) 

■ 


Portugal 

2.70 

10.4 

(1.10) 

-1.4 

(0.95) 

EE 


Serbia 

4.21 

7.4 

(1.50) 

-2.0 

(1.47) 



Norway 

4.75 

23.8 

(2.30) 

-2.4 

(2.36) 



Brazil 

3.72 

0.1 

(1.20) 

-2.8 

(1.11) 



Italy 

3.95 

3.1 

(1.11) 

-2.9 

(1.10) 



Tunisia 

2.46 

4.2 

(1.06) 

-3.3 

(1.26) 



Hong Kong-China 

2.58 

-0.7 

(2.01) 

-3.9 

(2.01) 



Austria 

4.09 

1.9 

(1.68) 

-5.0 

(1.50) 



United Kingdom' 

4.22 

18.5 

(1.77) 

1.0 

(1.57) 


□ 


-10 0 10 
1 . Response rate too low to ensure comparability. Statistically significant score point 

Source: OECD PISA 2003 Database. differences are marked in a darker tone. 
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a positive association with mathematics performance, even when considered in the wider context 
of teaching and learning, in all countries except Mexico and the partner economies Macao-China 
and Thailand where there is no significant relationship. In 19 of the OECD countries the effect of 
the number of books in the home is of 10 score points or more. Clearly, this factor plays a signifi- 
cant role in achievement independentlv of the other measures of socio-economic background and 
of other school and student effects. 


Figute 5,5 ■ Number of books in the home and mathematics performance 


Bivariate 

Multivariate 


Mean 

Effect 

S.E. 

Effect 

S.E. 

Sweden 

3.92 

34.4 

(1.51) 

17.5 

(1.18) 

Spain 

3.76 

28.8 

(1.36) 

16.0 

(1.26) 

Slovak Republic 

3.53 

26.4 

(1.89) 

14.8 

(1.54) 

Switzerland 

3.37 

25.3 

(1.21) 

14.3 

(1.08) 

Korea 

3.57 

24.0 

(1.55) 

14.2 

(1.65) 

Norway 

4.00 

29.7 

(1.66) 

14.1 

(1.45) 

United States 

3.30 

28.4 

(1.18) 

14.0 

(1.16) 

Finland 

3.59 

28.6 

(1.47) 

12.9 

(1.22) 

New Zealand 

3.70 

29.0 

(1.59) 

12.7 

(1.32) 

Austria 

3.43 

17.1 

(1.28) 

12.0 

(1.20) 

Poland 

3.39 

31.2 

(1.49) 

11.8 

(1.18) 

Czech Republic 

4.11 

19.8 

(1.63) 

11.7 

(1.63) 

Iceland 

4.05 

24.9 

(1.73) 

11.5 

(1.47) 

Ireland 

3.34 

24.1 

(1.48) 

11.3 

(1.14) 

Denmark 

3.54 

27.6 

(1.77) 

11.3 

(1.46) 

Canada 

3.72 

20.6 

(0.98) 

11.1 

(0.70) 

Portugal 

3.04 

24.9 

(1.53) 

9.9 

(1.80) 

Australia 

3.87 

21.4 

(0.95) 

9.8 

(0.86) 

Luxembourg 

3.53 

16.5 

(1.30) 

9.8 

(1.21) 

Turkey 

2.55 

15.3 

(1.70) 

9.3 

(1.48) 

Germany 

3.67 

17.8 

(1.17) 

9.2 

(1.15) 

Latvia 

3.94 

21.3 

(2.16) 

9.2 

(1.51) 

Netherlands 

3.39 

12.9 

(1.34) 

8.9 

(1.28) 

Belgium 

3.36 

16.8 

(1.12) 

8.8 

(1.04) 

Hungary 

3.92 

15.2 

(1.24) 

8.7 

(1.18) 

Hong Kong-China 

2.54 

12.9 

(1.42) 

8.3 

(1.36) 

Greece 

3.20 

17.0 

(1.31) 

7.5 

(1.47) 

Russian Fed. 

3.81 

18.6 

(1.40) 

6.9 

(1.35) 

Japan 

3.50 

10.8 

(1.26) 

6.4 

(1.33) 

Brazil 

2.01 

12.0 

(2.27) 

6.1 

(2.20) 

Serbia 

2.65 

15.3 

(1.76) 

6.0 

(1.51) 

Tunisia 

2.31 

11.7 

(1.44) 

5.8 

(1.21) 

Uruguay 

2.71 

12.9 

(1.86) 

5.7 

(1.46) 

Italy 

3.51 

10.7 

(1.18) 

4.0 

(1.07) 

Thailand 

2.45 

8.3 

(1.66) 

1.8 

(1.43) 

Macao-China 

2.27 

7.0 

(3.70) 

1.7 

(3.16) 

Mexico 

2.12 

5.2 

(1.57) 

1.4 

(1.49) 

United Kingdom^ 

3.41 

26.0 

(1.37) 

11.0 

(1.19) 



1 . Response rate too low to ensure comparabilitv. 
Source: OECD PISA 2003 Database. 


Note: Statistically significant score point 
differences are marked in a darker tone. 
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In summarv, two of the three measures of students’ socio-economic background, the highest 
occupational status of parents and students’ estimates of the number of books in the home, remain 
almost universally significant contributors to achievement, even after accounting for a large number 
of other student and school characteristics. The size of these effects is generally diminished in the 
full analvtical model relative to their observed association with performance, indicating that other 
factors can help overcome disadvantages in students’ socio-economic background. While universally 
positively correlated with achievement, parents’ educational levels do not generally exert independ- 
ent effects after other factors are accounted for. 

Figut'e 3,6 ■ Students’ attitudes towards school and mathematics performance 



Mean 

Effect 

S.E. 

Effect 

S.E. 

Mexico 

0.42 

10.5 

(1. 11) 

7.7 

(1.02) 

Iceland 

0.00 

15.0 

(1.46) 

7.2 

(1.51) 

Latvia 

0.22 

8.7 

(1.94) 

6.4 

(1.31) 

Finland 

O.ll 

12.1 

(1.46) 

6.0 

(1.27) 

New Zealand 

0.10 

13.4 

(1.53) 

6.0 

(1.48) 

Norway 

-0.21 

15.8 

(1.86) 

4.4 

(1.76) 

Sweden 

0.02 

13.0 

(1.46) 

4.3 

(1.44) 

I'unisia 

0.72 

4.8 

(0.87) 

3.5 

(0.85) 

Thailand 

0.28 

7.6 

(1.31) 

3.1 

(1.26) 

Australia 

0.25 

10.2 

(1.10) 

2.8 

(0.96) 

Brazil 

0.53 

1.7 

(1.40) 

2.0 

(1.41) 

Switzerland 

0.03 

1.4 

(1.90) 

1.6 

(1.29) 

Denmark 

-0.03 

5.2 

(1.64) 

1.5 

(1.66) 

Portugal 

0.27 

6,6 

(1.31) 

1.4 

(1.13) 

Ireland 

0.13 

6.1 

(1.46) 

0.9 

(1.26) 

Uruguay 

0.11 

2.1 

(1.61) 

0.8 

(1.61) 

Serbia 

0.17 

-0.8 

(1.32) 

0.7 

(1.16) 

Italy 

-0.06 

0.6 

(1.08) 

0.3 

(1.36) 

Macao-Chitia 

-0.37 

1.2 

(5.68) 

-0.3 

(4.13) 

Russian Fed. 

0.19 

3.6 

(1.38) 

-0.3 

(1.60) 

Spain 

0.14 

5.1 

(1.28) 

-0.3 

(1.22) 

Canada 

0.06 

6.6 

(0.87) 

-0.3 

(0.70) 

Czech Republic 

-0.01 

1.3 

(1.33) 

-0.4 

(1.18) 

Austria 

0.12 

-2.2 

(1.00) 

-0.6 

(1.02) 

United States 

0.09 

6.6 

(1.23) 

-0.7 

(1.26) 

Luxembourg 

-0.23 

-2.5 

(1.33) 

-1.1 

(1.23) 

Poland 

-0.12 

-0.8 

(1.72) 

-1.1 

(1.42) 

Hong Kong-China 

-0.52 

6.3 

(1.90) 

-1.5 

(1.74) 

Korea 

-0.37 

1.2 

(1.16) 

-1.5 

(1.10) 

Germany 

-0.08 

-3.8 

(1.25) 

-2.2 

(1.08) 

Turkey 

0.13 

-1.0 

(1.32) 

-2.3 

(1.13) 

Japan 

-0.50 

-0.8 

(1.43) 

-2.4 

(1.38) 

Netherlands 

-0.19 

-U 

(1.43) 

-2.8 

(1.34) 

Slovak Republic 

0.03 

-6.4 

(1.35) 

-3.8 

(1.20) 

Greece 

0.08 

-5.6 

(1.53) 

-4.0 

(1.62) 

Belgium 

-0.19 

3.4 

(1.10) 

-5.1 

(1.10) 

Hungary 

-0.22 

-7.3 

(1.36) 

-5.7 

(1.35) 

United Kingdom^ 

0.12 

9.8 

(1.23) 

2.6 

(1.24) 

1 . Response rate too low 

to ensure comparability. 



Multivariate 


Score point difference 
per unit change in total homework 



Source: OECD PISA 2003 Database. 


Note: Statistically significant score point 
differences are marked in a darker tone. 
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Students' general perceptions of school 


Two indices in PISA 2003 represent student perceptions of school in general. These are: attitudes 
towards school and sense of belonging at school. Although it can be argued that attitudes should 
relate to achievement, an interesting question of causality arises here because it is not obvious if 
success in learning engenders better attitudes or if a positive attitude to school is effectively a factor 
in motivating students to learn. 


The effects on achievement of students’ attitudes towards school and sense of belonging at school 
appear in Figures 3.6 and 3.7. Students’ attitudes towards school are onlv weaklv correlated with 
achievement. The report finds statisticallv significant effects for about half the countries studied, 
but these are not in a consistent direction. Countries where positive student attitudes towards 
school are positivelv associated with mathematics performance include Norwav, Iceland, New 
Zealand, Sweden, Finland, Mexico, as well as Australia and the partner countries Latvia, Tunisia 
and Thailand. Countries where a more positive attitude towards school shows a negative associa- 
tion with mathematics performance include Flungarv, the Slovak Republic, Greece, Germanv and 
Belgium. Therefore, there appears to be a tendencv for the effect to be positive in countries with 
relativelv homogeneous school svstems and negative in a few highlv differentiated school svstems. 
For students’ sense of belonging at school, other teaching and learning factors offset anv positive 
(albeit weak) associations with student performance. In fact, in 20 of the OECD countries, a sense 
of belonging at school is negativelv associated with performance once other teaching and learning 
factors are accounted for — Turkev is the only OECD countrv where this effect is positive. 


Student motivation to learn mathematics 

The literature on students’ motivation to learn often makes a distinction between intrinsic and 
extrinsic motivation, commonly holding that intrinsic motivators are more effective than extrinsic 
ones in engendering engagement and performance. 

PISA views interest in the subject matter as an intrinsic motivational preference which affects intensitv 
of engagement with the subject. The report uses the index variable interest in and enjoyment of mathemat- 
ics to represent this construct. This variable derives from a series of questionnaire items on how much 
students enjov and look forward to doing mathematics. The report considers subject-matter interest to 
be an aspect of student learning strategies, especially if interest in the subject flows in some wav out of or 
from the teaching. This type of positive motivation might be expected to result in increa.sed achievement. 

In contrast to the intrinsic nature of interest and enjovment, students mav be motivated to studv 
mathematics bv its perceived importance to future education or to careers. To analvse this pos- 
sibilitv, the report uses the PISA index oj instrumental motivation in mathematics^ measured bv a series 
of questionnaire items on the perceived value of studving mathematics for these external reasons. 

Figures 3.8 and 3.9 give the effects of each of these measures of motivation on mathematics per- 
formance. Together, on average, the two measures of motivation to learn mathematics account for 
an additional 5% of performance variation among students but no additional performance variation 
among schools (see Table C.4, Variance explained bv model changes). Students’ motivation accounts 
for 1 1% of the variation in student performance in Norway, 9% in Denmark and Finland and 8% in 
Korea. Students’ reported levels of interest in and enjovment of mathematics show relativelv strong 
positive association with mathematics performance. However, this changes mainlv to moderate 
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negative effects in the full analytical model. In contrast, students’ instrumental motivation to learn 
mathematics, which also has a strong positive observed association with performance, continues to 
show significant positive effects in 13 of the OECD countries in the full model. Poland displays the 
strongest positive effects (11 score points), followed by Norwav and Spain (6 score points) and the 
United States, Canada and the Russian Federation (5 score points). It is interesting to note that in 
Poland, the United States, Canada and the Russian Federation, the effect of students’ interest in 
and enjovment of mathematics is negative while the effect of students’ instrumental motivation to 
learn mathematics is positive. 


Figure 5.7 ■ Students’ sense of belonging at school and mathematics performance 


Bivariate 

Multivariate 


Mean 

Effect 

S.E. 

Effect 

S.E. 

Turkey 

-0.44 

9.6 

(1.69) 

4.2 

(1.46) 

Tunisia 

-0.09 

3.6 

(0.93) 

1.9 

(0.96) 

Portugal 

0.09 

10.1 

(1.50) 

1.2 

(1.50) 

Mexico 

0.08 

3.7 

(0.94) 

0.4 

(0.97) 

Brazil 

0.13 

3.1 

(1.12) 

0.4 

(1.31) 

Czech Republic 

-0.27 

7.8 

(1.72) 

0.2 

(1.46) 

Uruguay 

0.24 

2.3 

(1.26) 

0.2 

(1.32) 

Russian Fed. 

-0.29 

7.7 

(1.00) 

0.1 

(0.96) 

Thailand 

-0.29 

6.9 

(1.42) 

0.0 

(1.56) 

Luxembourg 

0.23 

4.4 

(1.33) 

-0.2 

(1.15) 

Macao-China 

-0.61 

4.3 

(5.21) 

-1.1 

(4.27) 

Hungary 

0.08 

2.0 

(1.19) 

-1.4 

(1.21) 

Greece 

0.04 

2.2 

(1.44) 

-1.6 

(1.41) 

Serbia 

0.03 

0.2 

(1.02) 

-1.8 

(0.90) 

Poland 

-0.17 

7.5 

(1.35) 

-2.0 

(1.11) 

Switzerland 

0.19 

3.0 

(1.29) 

-2.6 

(0.92) 

Slovak Republic 

-0.16 

0.2 

(1.30) 

-2.8 

(1.15) 

Austria 

0.44 

0.1 

(0.95) 

-3.0 

(0.89) 

Latvia 

-0.21 

9.4 

(2.10) 

-3.1 

(1.75) 

Belgium 

-0.28 

-0.8 

(1.31) 

-3.5 

(1.31) 

Italy 

0.05 

-0.5 

(1.15) 

-3.9 

(1.15) 

Spain 

0.20 

0.4 

(1.37) 

4.6 

(1.13) 

japan 

-0.53 

-1.0 

(1.50) 

-4.8 

(1.50) 

Netherlands 

-0.06 

-2.8 

(1.47) 

-5.1 

(1.53) 

Germany 

0.24 

-3.4 

(1.36) 

-5.9 

(1.39) 

Korea 

-0.39 

1.0 

(1.31) 

-6.1 

(1.25) 

Hong Kong-China 

-0.61 

5.5 

(1.62) 

-6.3 

(1.71) 

Denmark 

0.01 

1.7 

(1.69) 

-6.5 

(1.50) 

Canada 

0.02 

-1.4 

(0.89) 

-7.2 

(0.81) 

Iceland 

0.16 

0.1 

(1.45) 

-7.7 

(1.20) 

Ireland 

0.08 

-4.7 

(1.42) 

-8.0 

(1.13) 

Norwav 

0.24 

-0.2 

(1.53) 

-8.1 

(1.21) 

New Zealand 

-0.01 

2.5 

(1.38) 

-8.4 

(1.32) 

Australia 

0.04 

0.9 

(1.19) 

-8.6 

(0.97) 

Sweden 

0.25 

-0.4 

(1.53) 

-9.1 

(1.26) 

Finland 

-0.02 

-1.9 

(1.23) 

-9.1 

(1.09) 

United Kingdom' 

0.08 

0.2 

(1.21) 

-6.8 

(1.30) 



10 


1. Response rate too low to ensure comparability. 
Source: OECD PISA 2003 Database. 


Note: Statistically significant score point 
differences are marked in a darker tone. 
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Positive attitudes towards school and motivation to learn mav be, independentlv of their impact on 
achievement, important outcomes in their own right. The four measures of students’ perceptions 
of school in general and their motivation to learn mathematics show positive correlations among 
themselves. This lack of independence among these measures no doubt accounts for the change in 
patterns of relationship when all of the measures enter into the same analvtical model. 


Figu{'e5.8 ■ Students’ interest in and enjoyment of mathematics 
and mathematics performance 


Bivariate 

Multivariate 


Mean 

Effect 

S.E. 

Effect 

S.E. 

Hong Kong-Cliina 

0.22 

22.0 

(1.25) 

5.1 

(1.83) 

Japan 

-0.39 

15.9 

(1.11) 

4.7 

(1.70) 

Korea 

-0.12 

23.3 

(1.03) 

2.5 

(1.71) 

Luxembourg 

-0.26 

9.8 

(1.18) 

1.9 

(1.77) 

Norway 

-0.17 

34.0 

(1.36) 

1.3 

(2.01) 

Macao-China 

0.13 

19.2 

(4.18) 

1.2 

(4.53) 

Switzerland 

0.12 

14.5 

(1.36) 

0.0 

(1.87) 

Netherlands 

-0.20 

15.1 

(1.47) 

-0.2 

(1.71) 

Belgium 

-0.17 

15.1 

(1.18) 

-0.5 

(1.46) 

Uruguay 

0.36 

15.9 

(1.62) 

-0.7 

(2.42) 

Hungary 

-0.21 

10.8 

(1.52) 

-1.5 

(1.80) 

Greece 

0.10 

19.8 

(1.30) 

-1.7 

(2.14) 

Germany 

0.04 

14.3 

(1.09) 

-2.6 

(1.31) 

Turkey 

0.55 

12.9 

(1.64) 

-3.2 

(2.10) 

Spain 

-0.07 

20.6 

(1.24) 

-3.3 

(1.93) 

Ireland 

-0.05 

17.1 

(1.52) 

-3.8 

(1.72) 

Czech Republic 

-0.19 

18.4 

(1.52) 

-3.8 

(1.81) 

Italy 

0.07 

14.1 

(1.15) 

-3.8 

(1.74) 

Iceland 

-0.11 

24.7 

(1.45) 

-4.2 

(1.68) 

Finland 

-0.24 

30.2 

(1.61) 

-4.6 

(1.79) 

Sweden 

0.09 

27.2 

(1.63) 

-4.7 

(1.76) 

Austria 

-0.28 

10.2 

(1.22) 

-5.3 

(1.48) 

Slovak Republic 

0.03 

15.4 

(1.67) 

-5.4 

(1.90) 

Tunisia 

0.94 

8.4 

(1.17) 

-5.5 

(1.76) 

Russian Fed. 

0.25 

11.5 

(1.70) 

-6.8 

(2.36) 

Canada 

-0.01 

19.9 

(0.94) 

-7.1 

(1.29) 

Denmark 

0.41 

28.1 

(1.56) 

-7.1 

(2.23) 

hailand 

0.71 

6.4 

(1.79) 

-7.2 

(2.52) 

United States 

0.04 

12.9 

(1.18) 

-7.5 

(1.33) 

Australia 

0.01 

17.2 

(1.07) 

-7.8 

(1.57) 

Mexico 

0.58 

7.9 

(1.52) 

-8.2 

(2.03) 

Portugal 

0.16 

15.6 

(1.75) 

-8.4 

(2.35) 

Brazil 

0.54 

5.3 

(2.07) 

-9.1 

(2.54) 

New Zealand 

0.12 

15.9 

(1.62) 

-9.1 

(2.07) 

Serbia 

-0.06 

1.7 

(1.57) 

-9.5 

(1.86) 

Poland 

0.11 

17.7 

(1.37) 

-11.2 

(1.85) 

Latvia 

0.05 

16.5 

(2.43) 

14.7 

(2.52) 

United Kingdom 

0.00 

13.8 

(1.30) 

-9.4 

(1.73) 


Score point difference 
per unit change in total homework 



1 . Response rate too low to ensure comparability. 
Source: OECD PISA 2003 Database. 


Note: Statistically significant score point 
differences are marked in a darker tone. 
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Student perceptions of their mathematics capability 

PISA assesses student perceptions of their capabilities in mathematics using three indices. One of 
these, the index oj anxiety in mathematics^ effectively represents an emotional reaction to mathemat- 
ics. High anxietv is measured bv agreement with items having to do with worrying about obtaining 
good marks or feeling helpless or nervous when doing mathematics problems. A second measure, 
the index oJ self-t^icacy in mathematics^ is more cognitive than affective in nature and derives from 


Figure 5.9 ■ Students’ instrumental motivation in mathematics 
and mathematics performance 


Bivariate 

Multivariate 


Mean 

Effect 

S.E. 

Effect 

S.E. 

Poland 

0.04 

18.8 

(1.63) 

10.8 

(1.65) 

Latvia 

0.07 

19.2 

(1.61) 

10.0 

(1.58) 

Norway 

O.IS 

27.9 

(1.55) 

6.2 

(1.55) 

Spain 

-0.05 

19.2 

(1.04) 

6.1 

(1.60) 

United States 

0.17 

16.8 

(1.23) 

5.5 

(1.28) 

Canada 

0.23 

19.0 

(0.86) 

5.2 

(0.94) 

Russian Fed. 

0.00 

10.1 

(1.54) 

5.1 

(1.54) 

Portugal 

0.27 

15.0 

(1.59) 

4.8 

(1.74) 

Belgium 

-0.32 

11.6 

(1.20) 

4.6 

(1.26) 

Slovak Republic 

-0.05 

11.8 

(1.36) 

4.5 

(1.66) 

Sweden 

0.02 

22.9 

(1.83) 

4.3 

(1.51) 

Serbia 

-0.20 

2.1 

(1.32) 

4.1 

(1.58) 

New Zealand 

0.29 

16.3 

(1.72) 

4.0 

(1.44) 

Italy 

-0.15 

9.9 

(1.29) 

3.9 

(1.67) 

Thailand 

0.49 

9.0 

(1.69) 

3.9 

(2.19) 

Finland 

0.06 

26.6 

(1.71) 

3.6 

(1.46) 

Tunisia 

0.52 

9.9 

(1.18) 

3.5 

(1.48) 

Greece 

-0.05 

13.2 

(1.33) 

3.3 

(1.86) 

Czech Republic 

0.01 

14.1 

(1.38) 

3.0 

(1.20) 

Korea 

-0.44 

19.0 

(1.15) 

2.8 

(1.43) 

Iceland 

0.31 

18.0 

(1.68) 

2.4 

(1.68) 

Hungary 

-0.11 

8.1 

(1.34) 

2.3 

(1.30) 

Uruguay 

0.27 

10.0 

(1.31) 

2.2 

(1.41) 

Germany 

-0.04 

9.7 

(1.29) 

1.8 

(1.23) 

Australia 

0.23 

15.6 

(0.94) 

1.7 

(1.41) 

Hong Kong-China 

0.12 

15.7 

(1.50) 

1.3 

(1.67) 

Turkey 

0.23 

9.3 

(1.47) 

1.1 

(1.75) 

Mexico 

0.58 

5.7 

(1.32) 

0.9 

(1.82) 

Ireland 

0.10 

8.3 

(1.40) 

0.9 

(1.32) 

Netherlands 

-0.26 

10.5 

(1.29) 

0.8 

(1.20) 

Japan 

-0.66 

11.5 

(1.15) 

0.8 

(1.57) 

Brazil 

0.40 

0.5 

(1.72) 

0.5 

(1.95) 

Luxembourg 

-0.41 

4.7 

(1.19) 

0.2 

(1.56) 

Denmark 

0.37 

21.0 

(1.48) 

-0.2 

(1.87) 

Switzerland 

-0.04 

8.4 

(1.54) 

-0.2 

(1.28) 

Austria 

-0.49 

3.1 

(1.15) 

-1.7 

(1.37) 

Macao-China 

-0.03 

4.5 

(3.79) 

-8.4 

(4.25) 

United Kingdom 

0.12 

11.6 

(1.45) 

2.9 

(1.54) 


Score point difference 
per unit change in total homework 



1. Response rate too low to ensure comparability. 
Source: OECD PISA 2003 Database. 


Note: Statistically significant score point differences 
are marked in a darker tone. 
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responses to questions about student confidence in their ability to solve specific kinds of mathemat- 
ics problems. The third measure, the index of self-concept in mathematics, represents responses to items 
on student perceptions of how good they are at mathematics in general. These three measures are 
not mutually independent. There is a strong positive correlation between self-concept in mathemat- 
ics and self-efficacy in mathematics and strong negative correlations between both of these and 
anxiety in mathematics; the correlation between anxiety in mathematics and self-concept in math- 
ematics is particularly pronounced (-0.80 on average in OECD countries; see Table B.I.). 


As Figure 3.10 shows, anxiety in mathematics has a significant negative association with perform- 
ance for most countries and, furthermore, the pattern remains the same even when taking other 
contextual and teaching and learning factors into consideration, with only Korea showing a signifi- 
cant positive effect. Among the OECD countries where anxiety in mathematics shows the largest 
negative effects Mexico (-13 score points) has above-average reported levels of anxietv, Denmark 
(-12 score points) and New Zealand (-11 score points) have below- average reported levels of anxietv 
and Poland (-15 score points) has average reported levels of anxiety. As noted earlier, these pat- 
terns mav relate to country or cultural differences in the interpretation bv students of the questions 
making up the anxietv scale. This potential source of bias needs to be investigated further. 


The association between students’ self-efficacv in mathematics and mathematics performance is 
positive and strong in all countries (Figure 3.11). Indeed, self-efficacv in mathematics shows the 
strongest overall effects of any factor in the teaching and learning analytical model in 12 OECD 
countries and 3 partner countries. The strength of this relationship is perhaps not surprising, as the 
items used to measure self-efficacv in mathematics to some extent resemble the actual test items, 
although the assessment items are more generic. The important difference between them is that the 
self-efficacy items indicate students’ perceptions of their ability to perform the task rather than their 
actual performance. Nevertheless, it can be argued that self-efficacv in mathematics, if not a proxy 
for achievement, is closer to achievement as a construct than anv other factor analysed in the model. 


Figure 3.12 demonstrates that self-concept in mathematics has a similar relationship with perform- 
ance both before and after other contextual and teaching and learning factors are considered: there 
is a strong and positive association with mathematics performance, although the strength of the 
association varies more among countries. These results are consistent with the high observed corre- 
lations of self-concept in mathematics with achievement. Self-concept in mathematics shows a posi- 
tive effect of 30 score points in Finland, and between 20 and 25 score points in Denmark, Iceland, 
Australia, the Slovak Republic, New Zealand, Norway, Poland and the partner country Latvia. In 
Denmark, Finland and Iceland self-concept in mathematics shows the strongest overall positive 
effects of anv of the factors analysed in the teaching and learning model. Students in Denmark 
report above-average levels of self-concept in mathematics. 

It is interesting to note that, although these three measures of student perceptions of capability 
are intercorrelated, all three exert independent effects on achievement when included together in 
the model. ^ This indicates that the analysis has measured relatively independent constructs. It also 
indicates that all of these factors are powerful predictors of achievement. However, PISA data do 
not show the direction of causation. The argument that students have a positive self-concept or self- 
efficacv in mathematics because they are good at mathematics is just as plausible as the argument 
that being more confident in learning mathematics will lead to better performance. In fact, these 
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results indicate that high levels of confidence and high performance are mutually reinforcing. The 
same is true for high levels of anxiety in learning mathematics and low performance. The report 
addresses the policy implications of this finding in Chapter 4. 


School size 

Two school-level measures, school size and socio-economic composition of the school, are used 
in the teaching and learning analytical model. School size was chosen because of its observed high 


Figure 5.10 ■ Anxiety in mathematics and mathematics performance 


Bivariate 



Mean 

Effect 

S.E. 

Effect 

S.E. 

Korea 

0.41 

-18.3 

(1.38) 

3.9 

(1.87) 

Iceland 

-0.20 

-33.1 

(1.34) 

1.0 

(1,54) 

Hong Kong-China 

0.23 

-20.3 

(1.72) 

-0.1 

(2.24) 

Japan 

0.44 

-14.4 

(1.18) 

-1.4 

(1.83) 

Tunisia 

0.62 

■ 10.0 

(1.33) 

-1.9 

(1.34) 

Netherlands 

-0.38 

-20.4 

(1.43) 

-1.9 

(1.65) 

Macao-China 

0.24 

-26.4 

(3.71) 

-2.9 

(4.23) 

Spain 

0.28 

-22.6 

(1.74) 

-3.4 

(1.73) 

Thailand 

0.49 

14.9 

(1.58) 

-4.1 

(1.75) 

Portugal 

0.15 

-27.7 

(1.40) 

-4.2 

(1.82) 

Australia 

-0.05 

-34.2 

(1.25) 

-4.3 

(1.40) 

Austria 

-0.27 

-20.9 

(1.03) 

-4.5 

(1.49) 

Belgium 

0.09 

-23.0 

(1.09) 

-5.1 

(1.34) 

United States 

-0.10 

-30.1 

(1.17) 

-5.1 

(1.46) 

Germany 

-0.25 

-22.2 

(0.87) 

-5.1 

(1.37) 

Switzerland 

-0.29 

-26.1 

(1.04) 

-5.5 

(1.36) 

Canada 

-0.04 

-30.6 

(0.79) 

-5.7 

(1.11) 

Czech Republic 

-0.05 

-32.0 

(1.35) 

-5.9 

(1.65) 

Finland 

-0.31 

-41.7 

(1.51) 

-6.3 

(1.88) 

Luxembourg 

-0.01 

-20.8 

(1.17) 

-6.4 

(1.65) 

Uruguav 

0.30 

-28.2 

(1.71) 

-6.7 

(1.99) 

Ireland 

0.07 

-30.0 

(1.53) 

-7.0 

(2.24) 

Turkey 

0.34 

-19.3 

(1.52) 

-7.1 

(1.63) 

Norwav 

-0.05 

-41.3 

(1.33) 

-7.8 

(1.65) 

Sweden 

-0.49 

41.2 

(1.56) 

-7.9 

(1.61) 

ItalY 

0.29 

-25.5 

(1.29) 

-8.2 

(1.45) 

Hungary 

-0.01 

-23.6 

(1.23) 

-8.4 

(1.72) 

Serbia 

0.28 

-23.6 

(1.23) 

-9.1 

(1.74) 

Greece 

0.16 

-28.6 

(1.42) 

-9.3 

(1.60) 

Slovak Republic 

0.04 

-37.0 

(1.03) 

-9.8 

(1.37) 

New Zealand 

-0.10 

-44.4 

(1.35) 

-11.1 

(1.92) 

Denmark 

-0.45 

-42.8 

(1.40) 

-12.4 

(1.81) 

Latvia 

0.12 

-42.1 

(1.99) 

-12.5 

(1.95) 

Mexico 

0.47 

-26.0 

(1.19) 

-12.7 

(1.15) 

Brazil 

0.57 

-27.4 

(2.24) 

-13.2 

(2.72) 

Russian Fed. 

0.14 

-37.3 

(1.68) 

-14.3 

(2.25) 

Poland 

0.04 

-44.8 

(1.34) 

15.1 

(1.65) 

United Kingdom^ 

-0.08 

-29.9 

(1.20) 

-3.7 

(1.84) 


Multivariate 


Score point difference 
per unit change in total homework 



1 . Response rate too low to ensure comparability 
Source: OECD PISA 2003 Database. 


Note: Statistically significant score point differences 
are marked in a darker tone. 
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correlation with achievement in manv countries, and because teaching strategies are treated here 
as characteristics of schools and hence might be expected to be related to school size. School size is 
most notable for its variability both within and between countries (see Figure 3.13). A mean school 
size of more than 1 000 students is found in Luxembourg and the partner economy Macao-China. 
Both of these countries also show large variations in school size. However, Korea and the United 
Kingdom, and the partner economy Hong Kong-China, have mean school sizes in the range of 900 
to 1 000 students, but with a much more homogeneous distribution. Countries with the smallest 
average school sizes also tend to show the smallest variation in school sizes. With some exceptions, 

Figute 5.11 ■ Self-efficacy in mathematics and mathematics performance 



0 10 20 30 


I . Response rate too low to ensure comparabilitv. 
Source: OECD PISA 2003 Database. 


hlore: Statistically significant score point differences 
are marked in a darker tone. 
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such as Greece, New Zealand and Poland, most countries with small mean school sizes are more 
sparselv populated. Whether the school is located in an urban of rural setting may therefore be an 
important variable. This issue could not be examined here but mav be of interest for secondary 
analysis within some countries. 


In general, Figure 3.14 shows that the simple observed relationship between school size and math- 
ematics performance is: the bigger the school, the better the performance. However, the strength of 
this association varies considerably and it is not significant in Greece, Iceland, Norway, Poland, the 

Figui-e 5,12 ■ Self-concept in mathematics and mathematics performance 



Mean 

Effect 

S.E. 

Effect 

S.E. 

Finland 

0.01 

44.9 

(1.19) 

29.8 

(1.94) 

Denmark 

0.24 

45.4 

(1.28) 

24.5 

(2.56) 

Iceland 

0.03 

39.6 

(1.14) 

24.4 

(1.88) 

Australia 

0.13 

39.4 

(1.10) 

24.4 

(1.31) 

Slovak Republic 

-0.05 

39.9 

(1.44) 

22.5 

(2.22) 

New Zealand 

0.15 

44.2 

(1.32) 

22.1 

(2.41) 

Norwav 

-0.18 

45.7 

(1.23) 

21.9 

(2.13) 

Latvia 

0.11 

41.8 

(1.93) 

21.5 

(2.12) 

Poland 

0.03 

44.8 

(1.39) 

20.3 

(2.17) 

Greece 

0.11 

34.1 

(1.56) 

19.2 

(2.41) 

Serbia 

0.02 

23.3 

(1.48) 

19.1 

(1.90) 

Sweden 

0.13 

46.2 

(1.56) 

19.0 

(1.81) 

Canada 

0.19 

34.1 

(0.66) 

18.4 

(1.56) 

Portugal 

-0.18 

30.9 

(1.18) 

18.4 

(1.72) 

Korea 

-0.35 

32.1 

(1.26) 

17.7 

(2.55) 

Czech Republic 

-0.09 

32.8 

(1.27) 

17.0 

(1.75) 

Spain 

-0.19 

30.5 

(1.13) 

16.6 

(1.95) 

Mexico 

0.17 

22.9 

(0.99) 

16.3 

(1.21) 

Macao-China 

-0.20 

30.6 

(3.69) 

15.2 

(4.07) 

United States 

0.25 

32.2 

(1.19) 

15.1 

(1.92) 

Austria 

0.07 

23.5 

(1.12) 

15.0 

(1.68) 

Uruguay 

0.02 

27.5 

(1.40) 

14.7 

(2.35) 

Russian Fed. 

0.13 

34.1 

(1.63) 

14.2 

(2.40) 

Brazil 

0.04 

22.3 

(1.57) 

13.8 

(2.22) 

Italy 

0.00 

23.6 

(1.06) 

13.5 

(1.77) 

Belgiu m 

-0.03 

24.7 

(1.19) 

13.0 

(1.35) 

Hong Kong-China 

-0.26 

27.1 

(1.56) 

12.8 

(2,58) 

Thailand 

-0.09 

16.9 

(1.71) 

11.9 

(2.09) 

Ireland 

-0.03 

32.4 

(1.55) 

11.2 

(2.64) 

Turkey 

0.02 

22.2 

(1.56) 

11.1 

(1.83) 

Tunisia 

0.15 

13.9 

(0.96) 

10.8 

(1.41) 

Netherlands 

0.00 

22.4 

(1.44) 

10.6 

(1.72) 

Switzerland 

0.13 

25.3 

(1.15) 

9.9 

(1.77) 

Hungary 

-0.15 

23.7 

(1.25) 

9.7 

(1.66) 

Germany 

0.15 

23.1 

(0.97) 

8.8 

(1.50) 

Japan 

-0.53 

18.2 

(1.10) 

5.3 

(2.17) 

Luxembourg 

0.07 

19.1 

(1.14) 

4.6 

(1.66) 

United Kingdom 

0.11 

34.5 

(1.43) 

17.2 

(2.26) 


Multivariate 


Score point difference 
per unit change in total homework 




1. Response rate too low to ensure comparability. 
Source: OECD PISA 2003 Database. 


Note: Statistically significant score point differ- 
ences are marked in a darker tone. 
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United States, the Slovak Republic, Germany, Luxembourg, the Czech Republic, Turkey, Spain, Italy, 
Switzerland, and the partner economies Brazil, Macao-China and the Russian Federation. This effect 
remains significant for most countries when considering other contextual and teaching and learning 
factors in the analytical model, but is much reduced (only 10 score points or more in 11 countries). 
These results do not indicate that the high correlations commonly observed between school size and 
achievement are likely to be products of what takes place in schools, or of student ability or other 
characteristics of schools or their students. Although it is interesting that the partner economy Hong 
Kong-China has the largest school effects in Figure 3.14, caution is required in interpreting the results 
as the number of schools in the sample is relatively small compared to other countries. 

Fi^ute 5.15 ■ School size 


Standard 



Mean 

deviation 

Macao-Cliina 

1591 

1151 

Luxembourg 

1210 

703 

Hong Kong-China 

986 

228 

Korea 

993 

397 

United Kingdom 

901 

411 

Tunisia 

877 

424 

Portugal 

732 

397 

Japan 

670 

396 

Netherlands 

800 

524 

Australia 

653 

385 

Serbia 

68+ 

411 

Spain 

600 

355 

New Zealand 

671 

510 

Belgium 

520 

310 

Brazil 

704 

593 

Canada 

591 

446 

Germany 

559 

461 

Ireland 

484 

241 

Sweden 

534 

355 

Turkey 

670 

631 

United States 

610 

614 

Thailand 

702 

742 

Denmark 

374 

228 

Italv 

448 

323 

Czech Republic 

380 

215 

Slovak Republic 

385 

221 

Finland 

313 

167 

Austria 

385 

340 

Hungary 

343 

231 

LIruguav 

361 

391 

Russian Fed. 

427 

377 

Poland 

335 

256 

Greece 

25 + 

125 

Switzerland 

384 

455 

Latvia 

369 

338 

Norway 

218 

139 

Iceland 

261 

214 

Mexico 

279 

409 


Source: OECD PISA 2003 Database. 
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Socio-economic composition of the school 

Because of the wav many schools cluster within communities, parent choice of school, the existence 
of public and private schools, and other factors, schools within a countrv mav differ substantiallv in 
the socio-economic background of their student bodies. Figure 3.15 shows that in most countries 
there is considerable variation among schools in the average socioeconomic backgrounds of their 
students. It is therefore appropriate to include in the model a measure of the socio-economic com- 
position of the school. The index chosen for this purpose was the average of the highest parental 
occupation for students in the school, entered as a school-level predictor in the analvtical model. 

There is a strong positive association between the school average of students’ socio-economic back- 
ground and mathematics performance. Figure 3.16 shows this in a standardised form that allows 

Figui-e 5.14 ■ School size and mathematics performance 


Bivariate 

Multivariate 


Mean 

Effect 

S.E. 

Effect 

S.E. 

Hong Kong-China 

986 

116.4 

(7.65) 

62.3 

(4.50) 

Uruguay 

361 

40,0 

(1.61) 

16.2 

(1.26) 

Latvia 

369 

30.3 

(2.65) 

15.5 

(2.12) 

Belgium 

520 

29.3 

(6.08) 

12.7 

(2.39) 

Denmark 

374 

33.0 

(6.47) 

12.0 

(4.09) 

Finland 

313 

22.4 

(2.8+) 

11.9 

(3.22) 

Netherlands 

800 

18.5 

(2.84) 

11.3 

(3.08) 

Austria 

385 

15,7 

(5.19) 

11.2 

(2.88) 

Korea 

993 

28,0 

(4.64) 

10.3 

(1.40) 

Portugal 

732 

28.2 

(3.85) 

10.2 

(0.81) 

Hungary 

343 

22.4 

(11.44) 

7.5 

(4.66) 

Sweden 

534 

16.6 

(3.30) 

7.0 

(2.89) 

Canada 

591 

11.4 

(1.43) 

7.0 

(0.94) 

Tunisia 

877 

12,6 

(4.48) 

6.8 

(2.06) 

Ireland 

484 

17.3 

(5.15) 

6.6 

(3.15) 

Switzerland 

384 

10.1 

(5.15) 

6.1 

(4.51) 

Japan 

670 

25.3 

(1.03) 

5,8 

(1.06) 

Australia 

653 

24.9 

(1.34) 

4.9 

(1.17) 

Russian Fed. 

427 

14.8 

(4.91) 

4.8 

(3.25) 

Italy 

448 

11.5 

(5.59) 

4.2 

(3.52) 

Serbia 

684 

8.8 

(1.52) 

4.1 

(0.97) 

Thailand 

702 

13.9 

(0.29) 

4.1 

(0.43) 

Spain 

600 

9.6 

(4.11) 

4.0 

(2.29) 

Mexico 

279 

5.3 

(1.87) 

3.7 

(1.33) 

Turkey 

670 

3.1 

(3.16) 

3.6 

(2.93) 

Macao-China 

1591 

4,5 

(2.82) 

3,6 

(1.87) 

New Zealand 

671 

15,2 

(0.94) 

3.5 

(1.01) 

Czech Republic 

380 

8.6 

(9.01) 

3.3 

(3.97) 

Brazil 

704 

2.7 

(2.19) 

1.6 

(0.98) 

Luxembourg 

1210 

4.5 

(1.12) 

1.0 

(0.78) 

Germany 

559 

8,2 

(4.25) 

0.6 

(2.46) 

Slovak Republic 

385 

14.1 

(7.64) 

0.4 

(2.67) 

United States 

610 

1.1 

(2.27) 

-0.2 

(1.26) 

Poland 

335 

18.3 

(2.70) 

-1.5 

(2.65) 

Norway 

218 

8.8 

(7.99) 

-4.8 

(7.55) 

Iceland 

261 

5.1 

(4.93) 

-5.5 

(4.36) 

Greece 

254 

-2.3 

(16.24) 

-19.6 

(7.27) 

United Kingdom 

901 

11.0 

(4.71) 

7.4 

(1.87) 


1. Response rate too low to ensure comparability. 
Source: OECD PISA 2003 Database. 


Score point difference per unit change in total homework 



Note: Statistically significant score point differences 
are marked in a darker tone. 


90 


Mathematics Teaching and Learning Strategies in PISA © OECD 2010 


ConrngMMl 




comparison with the school-level effects of other measures included in the analytical model. Even 
when considering other factors, one standard deviation increase in the school average of parents’ 
occupational status is associated with a positive effect of at least 20 score points in 20 countries. It is 
associated with a positive effect of at least 30 score points in Japan, the Netherlands, Italv, Hungary, 
Gernianv and the Czech Republic. Conversely, in Finland, Norway, Sweden, Denmark and Iceland 
this association is relatively weak or even negative (8 score points or less). 


It is interesting to note that although associations at the school level are comparatively weak in 
Denmark, Finland, Norway and Sweden, there are comparatively strong associations at the stu- 
dent level (8 or 9 score points; the maximum effect among countries is 10 score points). In other 

Figute 3.15 ■ School average highest parents’ occupational status 


Standard 

deviation 


School average 

highest parents’ occupational index 


United States 

51.72 

8.14 

Nor wav 

54.53 

8.26 

Sweden 

51.35 

7.40 

Australia 

51.23 

7.53 

Netherlands 

51.13 

6.96 

Iceland 

49.28 

8.56 

Canada 

50.24 

7.70 

United Kingdom 

50.65 

8.34 

Serbia 

49.15 

8.14 

Finland 

48.81 

7.44 

New Zealand 

49.47 

7.54 

Czech Republic 

49.55 

7.27 

Denmark 

49.60 

8.16 

Latvia 

48.06 

7.53 

Japan 

47.65 

6.08 

Ru.ssian Fed. 

47.46 

7.02 

Belgium 

47.86 

9.02 

Switzerland 

47.67 

7.18 

Korea 

45.84 

5.70 

Ireland 

46.66 

7.25 

Slovak Republic 

45.86 

8.41 

Germanv 

47.33 

8.21 

Luxembourg 

48.12 

8.12 

Poland 

45.63 

9.94 

Austria 

45.79 

10.21 

Hungary 

41.96 

9.75 

Spain 

44.11 

8.83 

Italy 

42.20 

9.97 

Uruguav 

43.25 

10.38 

Greece 

41.99 

9.00 

Hong Kong-China 

41.13 

5.94 

Portugal 

40.53 

8.16 

Macao-China 

40.10 

6.29 

Turkev 

38.54 

9.07 

Brazil 

36.61 

10.20 

Tunisia 

37.12 

9.72 

Mexico 

37.17 

12.16 

Thailand 

31.65 

7.56 



Source: OECD PISA 2003 Database. 
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countries, the school average effects of parents’ occupational status are independent of and sub- 
stantiallv larger than student-level effects, indicating that in most countries students attending a 
school in which most students are from relativelv advantaged socio-economic backgrounds are at 
an academic advantage. This result is most striking in Japan and Korea, where at the student level 
there is no association, but one standard deviation improvement in the school average of parents’ 
occupational status shows a positive effect of 37 score points (japan) and 26 score points (Korea). 
Finland and Japan demonstrate two different situations where both countries achieve high mean 
performance, but Finland has a relativelv homogenous distribution of school-level parents’ occupa- 
tional status, while this is not the case in Japan. 


Figut-e 3.16 ■ School average of the highest international socio-economic index of 
occupational status (HISEI) of both parents and mathematics performance 


Multivariate 



Mean 

Effect 

S.E. 

Effect 

S.E. 

Japan 

47.65 

77.8 

(0.83) 

37.1 

(1.63) 

Netherlands 

51.13 

52.1 

(3.46) 

36.6 

(2.53) 

Italy 

42.20 

49.1 

(0.68) 

33.9 

(1.11) 

Hungary 

41.96 

56.2 

(1.28) 

32.9 

(1.69) 

Germany 

47.33 

50.6 

(3.37) 

31.3 

(2.05) 

Czech Republic 

49.55 

53.9 

(4.60) 

30.9 

(3.07) 

Luxembourg 

48.12 

53.5 

(1,16) 

28.1 

(1.82) 

Turkey 

38.54 

50.0 

(0.94) 

27.6 

(1.63) 

Belgium 

47.86 

53.0 

(2.46) 

27.3 

(1.83) 

Austria 

45.79 

47.1 

(1,28) 

26.6 

(1.79) 

Korea 

45.84 

58.3 

(1.08) 

25.6 

(1.35) 

Slovak Republic 

45.86 

46.7 

(0.63) 

25.2 

(0.93) 

Greece 

41.99 

40.2 

(1.07) 

24.8 

(1.56) 

Brazil 

36.61 

40.2 

(1.74) 

23.6 

(1.34) 

Uruguay 

43.25 

44.4 

(0.76) 

23.0 

(1.14) 

Serbia 

49.15 

41.2 

(0.66) 

21.2 

(1.02) 

Tunisia 

37.12 

31.9 

(0.32) 

20.3 

(0.91) 

I long Kong China 

41.13 

48.7 

(1.24) 

20.2 

(1.79) 

Thailand 

31.65 

36.4 

(0.82) 

20.1 

(1.25) 

Switzerland 

47.67 

39.5 

(0.90) 

18.6 

(1.49) 

Mexico 

37.17 

25.9 

(0.32) 

17.1 

(0.76) 

Australia 

51.23 

39.8 

(3.37) 

16.3 

(2.24) 

Macao-China 

40.10 

23.8 

(3.52) 

15.4 

(3.95) 

United States 

51.72 

41.1 

(0.91) 

15.0 

(1.37) 

New Zealand 

49.47 

36.0 

(1.76) 

13.3 

(1.64) 

Ireland 

46.66 

34.6 

(1.69) 

12.2 

(1.90) 

Russian Fed. 

47.46 

30.4 

(1.18) 

11.4 

(1.63) 

Latvia 

48.06 

26.6 

(1.37) 

11.3 

(1.57) 

Portugal 

40.53 

35.5 

(0.98) 

10.7 

(1.27) 

Canada 

50.24 

25.8 

(0.78) 

10.5 

(0.73) 

Spain 

44.11 

26.4 

(0.59) 

10.4 

(1.09) 

Poland 

45.63 

29.7 

(1.36) 

9.7 

(1.63) 

Denmark 

49.60 

29.5 

(1.85) 

8.1 

(1.93) 

Sweden 

51.35 

25.0 

(1.62) 

5.4 

(1.66) 

Norway 

54.53 

19.2 

(1.71) 

3.5 

(1.55) 

Iceland 

49.28 

8.0 

(1.87) 

0.8 

(1.66) 

Finland 

48.81 

9.7 

(0.99) 

-2.8 

(1.10) 

United Kingdom' 

50.65 

37.3 

(2,87) 

13.0 

(1.22) 


Score point difference 
per unit change in total homework 


1 . Response rate too low to ensure comparability. 
Source: OECD PISA 2003 Database. 


Note: Statistically significant score point differences 
are marked in a darker tone. 
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THE MEASURED EFFECTS OF TEACHING AND LEARNING IN THE ANALYTICAL 
MODEL 


Homework time 

The time students spend on homework is widely considered an important element of both teaching 
and learning strategies. Teachers varv in the amount and tvpe of homework thev assign and students 
obviously differ in the amount of time spent on homework. This last point is of direct interest here as 
time spent on homework may be an important element of student learning strategies. It is also possible 
tliat school policy, or policies developed bv local or state authorities, influences homework assignment. 
From the perspective of the Carroll model discussed in Chapter 2, homework is one of the few wavs 
of increasing the time spent learning in school systems where the total learning time in school is fixed. 

A full analysis of homework should examine both the amount of homework assigned and the amount 
of time actually spent on homework, as well as the nature of the homework, its supervision and moni- 
toring. Unfortunately, PISA does not provide measures of all of these elements. However, PISA 2003 
does collect two measures of students’ reports on how much time thev spend on homework: hours per 
week of total homework and hours per week of mathematics homework. Figures 3.17 and 3.18 give 
the effects for these two measures of homework. Note that, again, the effect is shown in standardised 
form, as the performance change associated with a rise of one standard deviation in homework time, 
which averages more than 300 minutes per week for total homework and 160 minutes for mathematics 
homework across the OECD countries. There is a high degree of variability in the amount of home- 
work reported bv students, suggesting that this measure mav not reflect verv accurately the prescribed 
amount of homework, but that different students report spending more or less time doing homework. 

For most countries, the number of hours students spend each week on homework in total is posi- 
tively associated with mathematics performance, while the number of hours spent each week solely 
on mathematics homework is negatively associated with mathematics performance. Of course these 
two measures are not independent: mathematics homework forms a significant component of the 
total amount of homework reported bv students in OECD countries, averaging 53% across all 
OECD countries and ranging from 33% in Hungary, Italy, the Netherlands and Sweden to 55% in 
Mexico. When looking at both these measures in the context of other factors, one might therefore 
expect that the effects of total homework would suppress the effects of mathematics homework. 
However, this is not the case, as shown bv the observed negative association between mathematics 
homework and mathematics performance in 19 of the countries studied (Figure 3.18). 

While a negative relationship between homework and achievement mav seem counter-intuitive, 
it is conceivable that assigning extra homework to weaker students along with the likelihood that 
stronger students finish standard homework in less time could produce this relationship. However, 
such a relationship is also inconsistent with the literature on homework. As in earlier work, a new 
synthesis of homework research across studies employing a variety of correlational and quasi- 
experiniental methods (Cooper et al, 2006) reports positive homework effects in languages, arts 
and mathematics. Unfortunately, this synthesis covers only studies conducted in the United States, 
but the observed association between mathematics homework and mathematics performance in the 
United States is consistent with Cooper’s work, although the relationship is weak (5 score points). 

To what extent are homework effects characteristic of particular countries? In particular, to what 
extent are thev characteristic of the wav in which various countries treat homework? It is notable 
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that the strongest negative effects for mathematics homework in the teaching and learning analytical 
model are seen in Finland, Sweden, Norway, Switzerland and Iceland, which is also the case for the 
observed associations with performance. 

Another noteworthy finding concerns the performance within each country of students report- 
ing no mathematics homework compared to that for students reporting some homework. In most 

Figure 5.17 ■ Hours per week of total homework and mathematics performance 


Mean 
number of 
hours 
per week 


Change in 
mathematics score 


Change in mathematics 
score wlien accounting 
for other background, 
teaching and learning 
characteristics 


New Zealand 

4.5 18.5 

(2.65) 

12.1 

(2.19) 

Korea 

3.5 15.4 

(2.38) 

11.8 

(2.74) 

Thailand 

6.9 16.9 

(1.31) 

11.0 

(1.61) 

Spain 

7.4 15.0 

(1.87) 

10.7 

(1.92) 

Poland 

8.1 8.4 

(1.18) 

10.4 

(1.32) 

Iceland 

4.6 8.5 

(2.81) 

10.0 

(2.98) 

Hong Kong-China 

6.8 11.7 

(1.17) 

9.8 

(1.92) 

Ireland 

7.7 14.9 

(1.38) 

9.5 

(1.32) 

Norway 

4.8 8.0 

(2.26) 

9.5 

(2.43) 

United States 

5.7 18.1 

(1.89) 

9.2 

(2.04) 

Brazil 

4.9 7.8 

(1.58) 

9.0 

(2.08) 

Japan 

3.8 10.0 

(2.06) 

8.7 

(2.70) 

Mexico 

5.8 13.0 

(1.07) 

7.8 

(1.57) 

Belgium 

6.2 5.5 

(1.48) 

7.5 

(1.61) 

Netherlands 

5.7 2.4 

(1.43) 

7.1 

(1.49) 

Luxembourg 

6.1 -1.0 

(2.03) 

6.8 

(2.19) 

Canada 

5.6 9.4 

(1.20) 

6.6 

(1.06) 

Australia 

5.7 14.7 

(1.38) 

6.5 

(1.53) 

Macao-China 

7.8 13.0 

(3.27) 

6.5 

(4.26) 

Sw itzerland 

4.6 -6.3 

(2.49) 

6.1 

(2.97) 

Portugal 

4.9 7.7 

(2.02) 

6.0 

(2.15) 

Finland 

3.7 -4.2 

(2.44) 

5.9 

(2.91) 

Greece 

8.3 9.0 

(1.29) 

5.9 

(1.04) 

Turkey 

5.9 5.1 

(1.46) 

5.5 

(2.07) 

Sweden 

3.9 4.6 

(2.71) 

4.9 

(2.44) 

Hungary 

10.0 0.4 

(0.94) 

4.5 

(1.12) 

Czech Republic 

3.8 -2.3 

(1.80) 

3.9 

(1.84) 

Latvia 

9.4 1.4 

(1.30) 

3.5 

(1.35) 

LIruguav 

6.8 5.4 

(1.50) 

2.8 

(1.87) 

Russian Fed. 

12.7 3.5 

(1.00) 

2.6 

(0.88) 

Germany 

6.3 -4.5 

(1.76) 

2.0 

(2.02) 

Austria 

4.0 -6.9 

(2.23) 

1.8 

(3.02) 

Tunisia 

4.9 6.8 

(1.68) 

1.1 

(2.05) 

Serbia 

5.3 3.1 

(1.49) 

1.1 

(1.64) 

Italy 

10.5 0.5 

(0.77) 

0.5 

(0.92) 

Slovak Republic 

8.4 -1.9 

(1.52) 

0.5 

(1.35) 

Denmark 

5.4 -2.9 

(2.83) 

0.0 

(2.91) 

United Kingdom 

6.0 19.6 

(1.72) 

13.9 

(1.70) 


Score point difference 
per unit change in total homework 



1 . Response rate too low to ensure comparability. 
Source: OECD PISA 2003 Database. 


Note: Statistically significant score point 
differences are marked in a darker tone. 
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cases, the proportions of students reporting no mathematics homework were small. In virtually 
all countries, however, those reporting no homework performed at significantly higher levels than 
those reporting some homework. This result indicates that a small number of students can maintain 
high achievement in mathematics with no homework in that subject. Whether this is a matter of 
underlying ability or the influence of favourable school characteristics or instructional organisation 
is not clear. 


Figup-e 5,18 ■ Hours per week of mathematics homework and mathematics performance 


Mean 
number of 
hours 


Change in 
mathematics score 


Change in mathematics 
score when accounting 
for other background, 
teaching and learning 
characteristics 


Macao-China 

4.34 

5.3 

(2.07) 

2.8 

(3.27) 

Tunisia 

2.76 

5.2 

(1.33) 

1.5 

(1.59) 

Serbia 

2.43 

0.5 

(1.23) 

0.6 

(1.55) 

Thailand 

4.02 

10.0 

(0.93) 

0.4 

(1.17) 

Mexico 

3.20 

7.3 

(0.74) 

-0.2 

(1.26) 

Greece 

3.31 

5.3 

(1.24) 

-0.4 

(1.19) 

Uruguay 

2.83 

0.7 

(1.42) 

-1.2 

(1.57) 

Russian Fed. 

5.03 

U.8 

(0.86) 

1.4 

(0.73) 

Slovak Republic 

3.16 

-5.5 

(1.15) 

-1.6 

(1.06) 

Australia 

2.34 

8.3 

(1.42) 

-1.8 

(1.26) 

japan 

1.98 

4.9 

(1.45) 

-2.4 

(1.80) 

Hong Kong-Chiiia 

3.08 

7.2 

(1.19) 

-2.8 

(1.70) 

Italy 

3.49 

-2.7 

(1.22) 

-3.1 

(1.13) 

United States 

2.77 

4.6 

(1.19) 

-3.2 

(1.20) 

Korea 

1.76 

8.0 

(2.05) 

-3.6 

(2.81) 

Turkey 

2.85 

2.1 

(1.35) 

-3.8 

(1.85) 

Canada 

2.81 

1.2 

(1.00) 

-3.8 

(0.92) 

Latvia 

3.68 

6.0 

(1.58) 

4.1 

(1.67) 

Belgium 

2.23 

-2.3 

(1.42) 

-4.5 

(1.52) 

Hungary 

3.29 

-6.1 

(1.15) 

-4.6 

(1.21) 

Austria 

1.75 

-15.8 

(2.35) 

-5.3 

(2.60) 

Ireland 

2.84 

3.0 

(1.64) 

-5.3 

(1.61) 

Brazil 

2.37 

0.2 

(1.52) 

-5.7 

(1.87) 

Portugal 

2.03 

1.3 

(1.77) 

-5.9 

(2.09) 

Spain 

2.94 

3.0 

(1.65) 

-5.9 

(1.84) 

Denmark 

2.59 

-10.3 

(1.89) 

-6.3 

(2.10) 

Germany 

2.59 

-12.1 

(1.49) 

-6.3 

(1.78) 

Netherlands 

1.87 

-8.4 

(1.62) 

-6.6 

(1.78) 

Czech Republic 

1.67 

-11.9 

(1.72) 

-7.3 

(1.76) 

Poland 

4.10 

-6.4 

(0.92) 

-8.3 

(0.97) 

New Zealand 

1.73 

1.2 

(2.32) 

-8.7 

(1.97) 

Luxembourg 

2.34 

-12.5 

(1.71) 

-9.2 

(1.74) 

Iceland 

2.27 

-8.4 

(2.28) 

-11.0 

(2.31) 

Switzerland 

1.85 

-19.9 

(2.38) 

-14.6 

(2.49) 

Norway 

1.83 

-9.8 

(1.91) 

-17.7 

(2.69) 

Finland 

1.46 

-18.5 

(2.37) 

-18.5 

(2.42) 

Sweden 

1.28 

-25.8 

(2.94) 

-18.5 

(2.46) 

United Kingdom 

2.04 

-3.1 

(1.54) 

-10.3 

(1.55) 


Score point difference per unit change 
in mathematics homework 



1 . Response rate too low to ensure comparability. 
Source: OECD PISA 2003 Database. 


Note: Statistically significant score point 
differences are marked in a darker tone. 
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This finding, of course, does not account for the generally positive effects for total homework. Very 
few students reported doing no weekly homework and for those that did the achievement results 
were the opposite of those of students doing no mathematics homework. To the extent that these 
results replicate across virtually all countries, it indicates a fundamental but complex pattern in 
which higher-performing students do more homework generally but do less mathematics home- 
work. This result may relate to the earlier point about mathematics being fundamentally a school 
subject. It is possible that the most able students learn their mathematics mainly in school and hence 


Figut-e 3.19 ■ Students being tutored in mathematics and mathematics performance 


Percentage 
of students 

being Change in 

tutored mathematics score 


Slovak Republic 7 

Mexico 90 

Serbia 21 

Luxembourg 16 

Korea 21 

Thailand 14 

Australia 13 

Portugal 26 

Poland 11 

Latvia 12 

Hong Kong-China 1 6 

Hungarv 14 

Germany 15 

Spain 23 

Canada 9 

Netherlands 5 

Czech Republic 6 

Austria 7 

Belgium 4 

Italy 13 

Switzerland 8 

Russian Fed. 15 

Greece 29 

Turkey 43 

Linked States 9 

Iceland 1 1 

Ireland 16 

Uruguay 20 

New Zealand 10 

Denmark 2 

Japan 4 

Macao-China 10 

Finland 1 

Brazil 21 

Sweden 4 

Norway 3 

United Kingdom^ 8 


-2.0 

(1.26) 

-4.2 

(2.47) 

• 6.3 

(1.04) 

-9.4 

(1.15) 

-2.8 

(0.88) 

-4.9 

(1.01) 

-6.5 

(1.03) 

-3.6 

(0.85) 

-10.0 

(1.22) 

-9.9 

(1.19) 

-6.4 

(1.04) 

-9.2 

(0.97) 

-12.2 

(0.85) 

-7.2 

(0.88) 

-11.5 

(0.87) 

-10.0 

(1.55) 

-9.3 

(1.22) 

-13.8 

(1.28) 

-11.0 

(1.63) 

-10.5 

(1.02) 

-12.9 

(1.71) 

-9.2 

(1.23) 

-6.0 

(1.04) 

-6.4 

(1.68) 

-14.6 

(1.16) 

-16.4 

(1.55) 

-10.4 

(1.42) 

-14.2 

(1.57) 

-14.5 

(1.76) 

-18.7 

(3.62) 

-9.4 

(1.53) 

15.3 

(2.83) 

-22.0 

(3.84) 

-15.7 

(1.25) 

-22.2 

(2.56) 

-25.8 

(2.49) 

-8.3 

(1.43) 


1 . Response rate too low to ensure comparability. 
Source: OECD PISA 2003 Database. 


Change in mathematics 
score when accounting 
for other background, 
teaching and learning 
characteristics 
-1.3 (1.09) 

-2.9 (2.35) 

-3.3 (0.98) 

-3.5 (1.15) 

-3.5 (0.87) 

-3.9 (0.94) 

-3.9 (0.92) 

-4.1 (0.81) 

-4.1 (0.92) 

-4.4 (0.94) 

-4.4 (0.88) 

-4.8 (1.08) 

-5.0 (0.86) 

-5.1 (0.81) 

-5.3 (0.76) 

-5.4 (1.23) 

-5.5 (1.21) 

-5.7 (1.11) 

-5.7 (1.51) 

-6.0 (0.87) 

-6.1 (1.40) 

-6.1 (1.04) 

-6.5 (0.92) 

-7.1 (1.60) 

-7.3 (1.10) 

-7.4 (1.31) 

-8.0 (1.17) 

-8.3 (1.43) 

-8.5 (1.65) 

-9.2 (3.26) 

-9.7 (1.40) 

-11.6 (2.59) 

-11.9 (3.29) 

12.3 (1.35) 

-13.0 (1.73) 

-14.4 (2.38) 

-6.6 (1.15) 

-20 -10 0 



Note: Statistically significant score point 
differences are marked in a darker tone. 
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have no need for homework, while less-well-performing students struggle more with mathematics, 
generating a need for mathematics homework. This and other aspects of the cumulative nature of 
mathematics learning would best be investigated using longitudinal studies, which follow student 
learning behaviours and performance over several years. 


It is interesting to note that in the majoritv of OECD countries there is verv little correlation 
between mathematics homework and self-efficacy in mathematics, although there are moderate 

Fi^up-eSTO ■ Out-of-school classes and mathematics performance 


Percentage 
of students 
taking out- 
of-school 
classes 


Change in 
mathematics score 


Change in mathematics 
score when accounting 
for other background, 
teaching and learning 
characteristics 


Turkey 

59 

3.0 

(0.98) 

0.6 

(0.90) 

Korea 

37 

3.7 

(0.66) 

0.3 

(0.61) 

Thailand 

20 

-0.6 

(0.96) 

-0.3 

(0.82) 

Tunisia 

35 

0.7 

(0.58) 

-0.4 

(0.47) 

Russian Fed. 

15 

-0.6 

(1.07) 

-0.6 

(0.99) 

Spain 

20 

-3.9 

(0.95) 

-0.9 

(0.85) 

Greece 

42 

-0.3 

(0.71) 

-1.0 

(0.57) 

Hong Kong- China 

13 

-0.6 

(0.88) 

-1.0 

(0.84) 

" Brazil 

26 

-3.9 

(0.98) 

-1.1 

(0.95) 

Czech Republic 

4 

-5. 5 

(1.97) 

-1.2 

(1.59) 

Ireland 

8 

-1.0 

(1.92) 

-1.6 

(1.43) 

Mexico 

89 

-5.1 

(0.97) 

-1.7 

(0.95) 

Latvia 

9 

-2.9 

(1.84) 

-1.7 

(1.35) 

Portugal 

9 

-3.4 

(1.27) 

-2.0 

(1.01) 

Canada 

3 

-7.3 

(1.68) 

-2.1 

(1.24) 

Macao-Chiiia 

9 

-7.8 

(2.23) 

-2.2 

(1.99) 

Llruguay 

12 

7.4 

(1.50) 

-2.2 

(1.33) 

Japan 

13 

-2.2 

(1.17) 

-2.2 

(1.02) 

Hungary 

16 

-6.7 

(0.73) 

-2.4 

(0.87) 

Slovak Republic 

6 

-3.7 

(1.58) 

-2.7 

(1.10) 

Belgium 

3 

-10.6 

(1.63) 

-3.6 

(1.59) 

Denmark 

4 

-12.7 

(2.45) 

-3.9 

(2.16) 

Iceland 

6 

-10.1 

(2.26) 

-4.3 

(1.62) 

Poland 

9 

-5.9 

(1.32) 

-4.3 

(1.09) 

Norway 

2 

-10.4 

(2.81) 

-4.4 

(2.29) 

Sweden 

1 

-12.4 

(4.22) 

-4.4 

(3.08) 

Luxembourg 

6 

-9.0 

(1.88) 

-4.7 

(1.78) 

Serbia 

4 

9.3 

(2.02) 

4.9 

(1.77) 

Switzerland 

3 

-8.3 

(3.37) 

-5.1 

(2.19) 

Italy 

2 

-9.3 

(1.90) 

5.6 

(1.61) 

Australia 

3 

-9.2 

(1.89) 

-5.8 

(1.49) 

United States 

4 

-13.3 

(2.49) 

-6.4 

(2.07) 

Germany 

2 

-13.5 

(2.67) 

-6.9 

(1.99) 

New Zealand 

5 

-17.3 

(1.66) 

-8.6 

(1.56) 

Austria 

1 

-13.4 

(3.24) 

-9.1 

(3.09) 

Finland 

1 

-13.8 

(5.35) 

-12.9 

(4.05) 

United Kingdom 

9 

0.7 

(1.44) 

-0.3 

(1.23) 


Score point difference 
per unit change in total homework 



1 . Response rate too low to ensure comparability. 
Source; OECD PISA 2003 Database. 


Note: Statistically significant score point 
differences are marked in a darker tone. 
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positive correlations in Japan (0.2S), Korea (0,20) and Australia (0.18). Similarlv, there is no cor- 
relation between mathematics homework and the number of books students have at home (which is 
used as a proxv for students’ socio-economic background): on average across OECD countries the 
correlation is 0.02. The presence or absence of these control variables in the model does not change 
the overall pattern of mathematics homework effects. 

Tutoring and out-of-school lessons 

Students reported the number of hours thev spend per week taking mathematics lessons outside school 
and having tutoring in mathematics. In most countries, onlv a relativelv small proportion of students 
spend anv time at all at either of these activities, so these variables are dichotomised to distinguish 
between those exposed to these activities and those not exposed. The dichotomised variables are sum- 
marised as the percentage of students in each countrv taking part in these activities. Results for the 
two variables appear in Figures 3,19 and 3,20. In almost all cases, the effects are negative. In some 
countries, the effects of having tutoring or taking part in out-of-class lessons are stronglv negative. 

Tutoring and other forms of out-of-school learning are similar to homework in that thev are wavs 
to increase time spent in learning. All things being equal, the Carroll model would predict that 
these activities should contribute to increased learning. While the results presented here seem to 
run counter to the theoretical prediction, there are nevertheless two competing interpretations of 
these results. 

First, it is possible that those taking part in tutoring or out-of-school lessons tend to be low-achiev- 
ing students and that this characteristic outweighs the extent to which extra learning converts low 
achievement into high achievement for participating individuals. However, this is not to sav that the 
activities do not convev individual benefit — PISA simplv did not measure this. Another possibilitv is 
that the students taking part in these activities tend to be students whose parents have the means to 
pav for extra tuition. More specificallv, it might be argued that participants in tutoring and out-of- 
school lessons are more likelv to be low-achieving students of such parents. This finding raises the 
issue of the mediating effects of students’ socio-economic background. However, on average across 
the OECD countries there is no correlation between the measures of students’ socio-economic 
background and students’ participation in tutoring and out-of-school lessons.^ Having said this, 
in Greece, Korea and Portugal there are weak positive correlations between the student socio- 
economic background measures and students’ participation in tutoring (between 0.11 and 0.21) 
and this is also the case for out-of-school lessons in japan, Korea, Mexico and Turkev (between 0.11 
and 0,21). These findings indicate that in these countries students coming from more advantaged 
socio-economic backgrounds are more likelv to take part in these activities. 

In general, the OECD countries with lower average achievement tend to have greater proportions of 
students participating in tutoring or out-of-school lessons: there is a strong negative cross-country 
correlation between these measures and overall performance. (The one clear exception to this 
finding is Korea, where performance is well above the OECD average and where 21% of students 
participate in tutoring and 37% of students participate in out-of-school lessons). Combined with the 
negative within-countrv correlations between these two measures and student performance, this 
suggests that additional learning bevond regular school instruction is a wav to compensate for the 
limited quantity of schooling in some countries. The strong negative correlation across countries 
between number of instructional hours per year and use of extra tuition supports this suggestion. 
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There is no wav to tell from these results if these activities have a marginal effect, which cannot 
be detected from the overall picture presented here, or if the effects of tutoring and out-of-school 
lessons are more positive for outcomes directlv related to the curriculum than for more general 
outcomes such as those measured bv PISA. Indeed, it can plausibly be argued that these activities 
are likelv to specificallv target narrower outcomes, such as school grades, than broader ones, such as 
building students’ competencies and self-confidence. More comprehensive studies of these phenom- 
ena are clearlv needed. However, some caution is required in interpreting these results, as it is not 
possible to dismiss the possibilitv of students in some countries giving sociallv desirable responses 
or interpreting the questions differently from the intended meaning. 


Learning strategies 

Learning strategies (sometimes referred to as meta-cognitive strategies) are generic approaches 
that students use to address a learning task. In the Carroll model, such strategies are at least looselv 
identified with abilitv to learn in the sense that it might be expected that students with effective 
learning strategies would learn more quicklv than other students. The Wang et al. (1993) synthesis 
identifies learning strategies as among the proximate factors that contribute to higher achievement. 
However, this research is silent on whether some of these strategies are more effective than other 
tvpes of strategies. The three indices used in PISA to measure students’ use of learning .strategies 
are memorisation/rehearsal strategies, elaboration strategies and control strategies (see Chapter 2). 

The effects for students’ use of memorisation/rehearsal strategies appear in Figure 3.21 . These effects 
are almost universallv negative, suggesting that memorisation is an ineffective strategv for learning 
mathematics and/or that weaker students have a greater tendency to use this strategv. It is interest- 
ing to note, however, that the observed effects are onlv slightlv more negative across countries and 
have a wider overall range than the teaching and learning model effects. In general across the OECD, 
countries with the largest positive observed effects have close to zero effects in the analytical model 
and those with the largest negative observed effects tend to have the most negative effects in the ana- 
Ivtical model. ^ Nevertheless, some countries, notablv Norwav, Sweden, Denmark, Australia, Japan, 
Korea, Spain, Finland, Canada and the partner economv Tunisia show a substantial shift in the size 
of the effect. This result implies that other measures analvsed in the model mediate the effects that 
the use of memorisation /rehearsal strategies has on performance in these countries. Interestinglv, 
however, there is no relationship between the size of the effect and achievement at the countrv level. 

One might argue that the negative effects for the use of memorisation/ rehearsal strategies are intui- 
tivelv plausible and consistent with other research. However, much of the available research speaks 
not to the negative effects of memorisation/rehearsal strategies but to the greater positive effects of 
such techniques as developing and using problem-solving skills. Elaboration relates to problem solv- 
ing and to the more general idea of attempting to establish meaning in the material one is attempt- 
ing to learn. While it is common to interpret these strategies as more effective than memorisation 
for learning mathematics (Grouws and Cebulla, 2000), the research covered in this review refers to 
the teaching of meaning as a teaching strategv rather than as a student learning strategv. 

The effects for students’ use of elaboration strategies appear in Figure 3.22. In the teaching and 
learning analvtical model the effects for elaboration strategies are mainlv negative or near zero. 
The strongest negative effects appear in New Zealand, Australia and Norway, where there are no 
observed associations between the use of elaboration strategies and mathematics performance. The 
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positive observed association between students’ use of elaboration strategies and mathematics per- 
formance in 26 countries, combined with the absence of countries where this strategy has a positive 
effect in the teaching and learning analvtical model, raises the question of whether other research, 
particularlv that based on less comprehensive models, is incorrect, or if other factors in the current 
analvtical model account for the shift. 


Figuf^e 5.21 ■ Memorisation/rehearsal strategies and mathematics performance 


Mean 


Change in 


Change in 
mathematics score 
when accounting for 
other background, 
teaching and learning 



index 

mathematics score 

characteristics 

Netherlands 

-0.16 

5.2 

(1.61) 

2.0 

(1.25) 

Sweden 

-0.08 

14.4 

(1.82) 

0.7 

(1.48) 

Norway 

-0.12 

21.8 

(1.55) 

0.6 

(1.75) 

Tunisia 

0.43 

5.9 

(0.92) 

0.0 

(1.21) 

Uruguay 

0.16 

-1.6 

(1.49) 

-0.8 

(1.57) 

Turkey 

0.10 

3.2 

(1.47) 

-1.2 

(1.76) 

Japan 

-0.56 

7.2 

(1.29) 

-1.9 

(1.37) 

Belgium 

-0.09 

-6.7 

(1.35) 

-1.9 

(1.17) 

Luxembourg 

-0.05 

-7.6 

(1.24) 

-2.5 

(1.26) 

Spain 

0.07 

6.8 

(1.23) 

-2.6 

(1.28) 

Ireland 

0.11 

4.7 

(1.65) 

-2.8 

(1.75) 

Latvia 

-0.14 

-1.3 

(3.09) 

-3.5 

(2.30) 

Brazil 

0.48 

-7.3 

(1.91) 

-4.0 

(2.28) 

Canada 

0.16 

6.5 

(0.97) 

-4.0 

(1.07) 

New Zealand 

0.13 

5.7 

(1.48) 

-4.1 

(1.56) 

Russian Fed. 

-0.04 

-0.6 

(1.27) 

-4.5 

(1.62) 

Denmark 

-0.27 

9.5 

(1.80) 

-4.7 

(1.63) 

Mexico 

0.56 

1.4 

(0.96) 

-4.8 

(1.06) 

Poland 

0.15 

-3.7 

(1.87) 

-4.8 

(1.58) 

Finland 

-0.19 

6.6 

(1.48) 

-4.8 

(1.27) 

United States 

0.31 

3.1 

(1.31) 

-5.0 

(1.47) 

Australia 

0.17 

7.9 

(1.17) 

-5.0 

(1.32) 

Iceland 

-0.03 

-0.5 

(1.47) 

-5.1 

(1.64) 

Flungary 

0.16 

-6.2 

(0.94) 

-5.4 

(1.19) 

Slovak Republic 

0.13 

-6.7 

(1.47) 

-5.8 

(1.33) 

Portugal 

-0.11 

-2.3 

(1.71) 

-6.0 

(1.72) 

Italy 

0.03 

-5.5 

(1.23) 

-6.1 

(1.34) 

Germany 

-0.06 

-9.1 

(1.16) 

-6.9 

(1.12) 

Czech Republic 

-0.05 

-5.7 

(1.52) 

-6.9 

(1.27) 

Switzerland 

-0.19 

-11.1 

(1.38) 

-7.1 

(1.02) 

Greece 

0.20 

-1.7 

(1.91) 

-7.3 

(1.91) 

Austria 

0.06 

11.3 

(0.97) 

-8.2 

(1.07) 

Serbia 

-0.05 

-12.4 

(1.53) 

-8.3 

(1.62) 

Hong Kong- China 

-0.15 

3.7 

(1.51) 

-8.5 

(1.58) 

Korea 

-0.35 

7.1 

(1.24) 

-9.5 

(1.64) 

1 hailand 

0.47 

-0.3 

(1.66) 

-9.9 

(2.57) 

Macao-China 

-0.03 

12.1 

(4.12) 

-10.1 

(3.76) 

United Kingdom 

0.11 

10.3 

(1.64) 

-1.0 

(1.56) 

1 . Response rate too low to ensure comparability. 




Score point difference per unit change 
in total homework 



Source: OECD PISA 2003 Database. 


Note: Statistically significant score point 
differences are marked in a darker tone. 
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Before examining this point further, it is necessary to look at the results for students’ use of con- 
trol strategies to learn mathematics. While the use of elaboration strategies may be identified with 
effectiyeness in learning, the use of control strategies may be thought of as indicators of efficiency, 
in the sense that the items used to measure this factor are linked to finding ways to focus on what 
it is important to learn. 


Figuie 5.22 ■ Elaboration strategies and mathematics performance 
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Source: OECD PISA 2003 Database. 


other background, 


ange in 
latics score 

teaching and learning 
characteristics 

(0,91) 

0.2 

(1.48) 

(1.26) 

-0.3 

(1.03) 

(1.08) 

-0.7 

(1.05) 

(1.37) 

-0.8 

(1.41) 

(1.55) 

-1.3 

(2.00) 

(3.34) 

-1.6 

(2.86) 

(1.02) 

-1.7 

(1.42) 

(1.45) 

-1.7 

(2.34) 

(1.49) 

-2.1 

(1.72) 

(1.16) 

-2.1 

(1.14) 

(3.92) 

-2.2 

(3.74) 

(1.07) 

-2.6 

(1.35) 

(1.43) 

-2.8 

(1.46) 

(1.45) 

-2.8 

(1.96) 

(1.38) 

-3.2 

(1.95) 

(1.58) 

-3.4 

(1.81) 

(1.21) 

-3.7 

(1.29) 

(1.12) 

-3.9 

(1.46) 

(1.06) 

-4.3 

(1.26) 

(1.32) 

-6.0 

(1.65) 

(2.03) 

-6.0 

(1.67) 

(1.34) 

-6.2 

(1.39) 

(1.61) 

-6.3 

(1.86) 

(1.84) 

-6.5 

(1.75) 

(1.65) 

6.7 

(2.03) 

(1.44) 

-6.9 

(1.53) 

(2.00) 

-7.2 

(2.22) 

(1.36) 

-7.8 

(1.36) 

(1.17) 

-8.0 

(1.50) 

(1.01) 

-8.1 

(1.00) 

(1.14) 

-8.6 

(1.35) 

(1.25) 

-9.1 

(1.57) 

(1.73) 

-9.6 

(1.47) 

(1.58) 

-10.2 

(1.83) 

(1.47) 

-12.0 

(1.70) 

(0.99) 

-16.1 

(1.20) 

(1.88) 

-16.6 

(1.90) 

(1.7S) 

-15.1 

(1.62) 

iparabilitv. 




Score point difference 
per unit change in total homework 



Note: Statistically significant score point 
differences are marked in a darker tone. 


M^them^tics Teaching and Learning Strategies in PISA © OECD 2010 


101 


CopvnghMS 


Ai-e 5tu4ents' Pei-ceptions of tbeii- Mgtbemgtics Tegcbing an4 Legi-ning Relgte4 to Mgtbemgtics Perfoi-mance? 



Afe Stujents' Pei-ceptfons of tbei> Mathematics Teaching an4 Learning Relate4 to Mathematics Pei-foi-mance? 


The results for students’ use of control strategies appear in Figure 3.23. Here the picture is much more 
mixed that for elaboration strategies. There is an observed positive association between students’ use 
of control strategies and mathematics performance in 20 countries, but in the teaching and learning 
analvtical model, there are only small positive effects found in New Zealand, Portugal, Australia, 
Canada, Korea, Turkev, Spain and in the partner economv Hon^ Kong-China. Further, there are 
negative effects in Sweden, the Netherlands, Denmark, the Slovak Republic, the Czech Republic and 
Belgium, as well as in the partner countries Latvia, the Russian Federation and Uruguay. The positive 
and negative effects are quite consistent across countries (countrv level correlation 0.67). 

These three indices stronglv intercorrelate: correlations as high as 0.60 or more are common within 
countries. In particular there are strong correlations between students’ use of control strategies and 
students’ use of memorisation /rehearsal strategies, with correlations of at least 0.90 in 16 of the 
OECD countries (Table B.l). Further factor analvsis of the items making up these indices shows that, 
while each of the three learning strategies can be clearlv identified, students’ use of memorisation/ 
rehearsal strategies accounts for much more of the mathematics performance variance than the other 
two learning strategies. However, the three measures of learning strategies are distinct and it is not 
the case that all students respond to each of the items included in the measures in a similar wav.^ 

One possible explanation for these results is that students’ use of learning strategies relates to their 
sense of self-efficacv in mathematics. Both areas involve perceptions of mathematics learning. In 
particular, if attempting to find meaning in mathematics is an effective learning strategv, students 
who employ elaboration strategies “to a greater extent” might be expected to have a higher sense of 
their self-efficacv in learning mathematics. In fact, all three learning strategies correlate positivelv 
with self-efficacy in mathematics. The most consistent correlations are found between students’ use 
of control strategies and student self-efficacv in mathematics, with correlations of at least 0.20 in 29 
of the OECD countries, including correlations of 0.50 in Korea, 0.43 in Finland and Mexico and 
0.40 in Turkev (see Annex B, Table B.l, Correlations among Selected Index Variables). There are 
correlations of at least 0.20 in 22 of the OECD countries for students’ use of elaboration strategies 
and in 18 of the OECD countries for students’ use of memorisation/rehearsal strategies. However, 
in Austria, the Czech Republic, Germanv and Switzerland there is no correlation between students’ 
use of memorisation/rehearsal strategies and students’ self-efficacv in mathematics. Accounting 
for students’ self-efficacv in mathematics reduces the observed positive effects of using learning 
strategies on mathematics performance, altering most of the positive values to negative ones (see 
Annex C, Multilevel Model, Table C.5, Effect of Mathematics Achievement of Learning Strategies 
Controlling for Self-Efficacy), a result which is consistent with the correlations in Table B.l. 
Nevertheless, removing self-efficacv in mathematics from the teaching and learning analvtical 
model Yielded almost no changes in the results. 

Of course, this raises further questions concerning the links between the underlving constructs 
of self-efficacv in mathematics and student learning strategies. Does greater use of learning strate- 
gies contribute to the development of a sense of self-efficacy? To what extent do the joint effects of 
learning strategies and self-efficacv in mathematics contribute to achievement? More importantlv, 
can teaching strategies influence students’ sense of self-efficacv in mathematics and use of learning 
strategies in ways that can enhance achievement? Or are these attributes, especially self-efficacv in 
mathematics, siinplv consequences of achievement or proxies for achievement? Models based on 
survev data break down at this point because the direction of causality cannot clearlv be delineated. 
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Co-operative and competitive learning situations 


The indices measuring students’ reported preference for co-operative and competitive learning 
situations in mathematics were derived from student responses to items on whether thev prefer 
working with others or helping others, or whether they want to be the best or do better than 
others. It is important to note that the co-operative learning construct used here as a student 


Figui-e5.25 ■ Control strategies and mathematics performance 
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1 . Response rate too low to ensure comparability. 
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Note: Statistically significant score point 


Source: OECD PISA 2003 Database. 
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preference is different from the construct of co-operative learning as a teaching strategy as used in 
the literature. In the literature it refers to specific ways of organising groups to facilitate learning 
(Slavin, 1994). PISA does measure this construct as well, but it would be inappropriate to infer that 
student preference for co-operative learning is a proxv for use of co-operative teaching strategies 
or a consequence of teaching through co-operative grouping. Nevertheless, this is not to imply that 


Figute 5.24 ■ Preference for co-operative learning situations and mathematics performance 
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1 . Response rate too low to ensure comparability. 
Source: OECD PISA 2003 Database. 
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schools or teachers cannot encourage either a co-operative or a competitive learning environment 
in their classrooms. 


The PISA results show that in several countries these two learning situations are not mutuallv exclusive, 
that is, students preferring competitive learning situations often tend also to enjov co-operating with 


Figute 5.25 ■ Preference for competitive learning situations and mathematics performance 
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1 . Response rate too low to ensure comparability. 
Source: OECD PISA 2003 Database. 
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other students in their learning. Students reported agreement or disagreement with a set of 10 different 
statements about situations in which to learn mathematics, so that students could report, for example, 
that thev like to work with others while also reporting that they want to be the best in the class. Indeed, 
the almost universally positive correlations between these two indices show that students often report a 
preference for both learning situations (Table B.l). There are strong positive latent correlations between 
student preferences for competitive and co-operative learning situations in the OECD countries Korea 
(0.84), Mexico (0.70) and Turkey (0.62). However, in several countries there is weak or no correlation 
between the two learning situations: in Finland (-0.01) and in the partner countries the Slovak Republic 
(-0.02) and the Czech Republic (0.08). It cannot be determined from the results if this is a function of 
response bias or of some characteristics of students or schools in these countries. 

Student preferences for learning situations are not strongly associated with mathematics performance 
when considered in the wider context of teaching and learning (Figures 3.24 and 3.25). The effects are 
non-significant in most countries and inconsistent in direction even in those countries where thev are 
significant. The observed effects for co-operative learning follow a similar pattern to the analytical model 
effects. Even in the minority of countries where there are strong observed effects, these become insig- 
nificant once other contextual and teaching and learning factors are accounted for (for example, there are 
positive observed effects in Korea and the partner economy Hong Kong-China, and a negative observed 
effect in the Slovak Republic). The situation for competitive learning is somewhat different: fairly large 
positive observed effects are attenuated in the teaching and learning analytical model. Similarly as for 
student learning strategies, removing the measure of self-efficacv in mathematics from the teaching and 
learning analvtical model does not change the results in anv significant way. Again, note that these are 
measured as student factors. It is plausible to argue that dispositions towards either competitive or co- 
operative learning mav themselves be learned or mav be characteristics of schools; however, the inclusion 
of these factors in the teaching and learning anahl:ical model at the school level yields no effect. 

TEACHING STRATEGIES 

Although PISA did not directly survey teachers, a limited number of measures of teaching strategies 
were collected via the student and school questionnaires. This report presents information provided bv 
school principals on innovation, teacher expectations, streaming and assessment in Chapter 2. However, 
these measures are not included in the teaching and learning analvtical model, since thev either have 
low correlations with achievement or only show small effects in earlv versions of the multi-level model. 

The main teaching strategy measures from the student questionnaire are the indices of student- 
teacher relations, disciplinarj climate and teacher support. All of these derive from a series of items in 
which students were asked to indicate how frequently specified behaviours occur in their mathemat- 
ics classes (see Chapter 2). 

Two additional school-level measures are included in the analvtical model as controls. These are 
school size (total students enrolled) and the socio-economic composition of the school (parents’ 
highest occupational level aggregated to the school). School size shows a moderate correlation with 
achievement in manv countries. The socio-economic composition of the school is highly correlated 
with achievement in almost all countries. 

It is important to point out that, although students mav influence the climate of a classroom, teaching 
strategies are fundamentally characteristic of teachers or classrooms and not of individual students. 
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Students’ perceptions of the classroom climate are the basis of the indices analysed. It would therefore 
be appropriate to examine these indices at both the student and classroom levels. However, because 
classrooms within a school are not identifiable in the PISA data, the classroom cannot function as a 
level of analysis in the model. Therefore the analysis aggregated the indices to the school level for 
modelling purposes. This procedure is defensible as long as differences between classrooms within 
a school are small. Unfortunately, the PISA analysis has no measure of the extent of such differences 
and no indication of the number of different teachers who are represented in the student responses. 
This lack of refinement is likelv to be one of the reasons whv many of the reported effects are small. 


Disciplinary climate 

As indicated in Chapter 2, disciplinary climate is an index derived from student responses to items 
about noise and disruption in the classroom, lost time and student behaviour towards the teacher. 

Figure 3.26 shows the effects of disciplinary climate at the student level. There is substantial varia- 
tion in average disciplinary climate across countries, amounting to close to one standard deviation 
unit between the highest -rated countries, Japan and the partner country the Russian Federation, to 
the lowest, the partner country Brazil. A stronger disciplinary climate is positively associated with 
mathematics performance in all countries. The observed effects and the anah^tical model effects are 
of similar magnitudes and are highly correlated, indicating that the impact that disciplinary climate 
has on performance is largely independent of other contextual and teaching and learning factors 
analysed in the model. 

As already noted, disciplinary climate is more appropriately measured at the classroom level than at 
the student level. In the absence of a classroom-level identifier, aggregation to the school level has 
been carried out. Indeed, an argument can be made that classroom disciplinary climate is a compo- 
nent of the broader school climate, although more directly under teacher control than other school 
climate factors, hence its identification as a teaching strategv.^^ 

The effects of school average disciplinary climate appear in Figure 3.27. The pattern of school- 
level means for each country is essentially the same as that at the student level. There is a positive 
observed association between disciplinary climate and mathematics performance in all countries, 
but this ranges from effects of 40 score points or more in Luxembourg, Turkey, Japan and the 
partner economies Hong Kong-China and Macao-China to less than 10 score points in Poland, 
Finland, Ireland, Iceland and the partner country Latvia. The effects from the teaching and learn- 
ing analytical model follow a similar pattern, remaining significantly positive in all countries except 
Finland, Ireland, Iceland, Poland and the partner country Thailand. Turkey, Belgium, Japan, Korea 
and Portugal and the partner economy Hong Kong-China have the strongest positive association 
between school average disciplinary climate and mathematics performance. 

These results indicate that disciplinary climate is one of the most robust predictors of achievement 
studied in the PISA 2003 survey. The existence of much larger school-level effects than student-level 
effects in many countries shows the importance of examining the effects of disciplinary climate at 
the school level, and that averaging student responses over schools yields a separate strong predictor 
of achievement. In Korea, the Netherlands, Greece, Denmark and Norway the school average disci- 
plinary climate has positive effects, but disciplinary climate at the student level shows no association 
with performance in the analytical model. Overall, the effects of school average disciplinary climate 
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are twice as strong as those effects at the student level in 19 countries. The countrv-level correlation 
of the mean value for school average disciplinarv climate and the size of the effect in the teaching 
and learning analvtical model is close to zero. This finding suggests that the observed effect within 
a countrv is a function of the relative values of disciplinarv climate within the countrv rather than 
of the average position of the countrv on the international scale. 


Figute5.26 ■ Disciplinary climate and mathematics performance 
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1. Response rate too low to ensure comparability. 
Source: OECD PISA 2003 Database. 


Note: Statistically significant score point 
differences are marked in a darker tone. 
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Student-teacher relations 


The PISA index cf student-teacher relations is derived from student responses to items on how well 
students g;et along with teachers, how interested teachers are in students’ work and whether teach- 
ers treat students fairlv. The results for this index appear in Figure 3.28. Like disciphnarj climate^ the 
means for student-teacher relations varv bv close to one standard deviation unit between countries, with 

Figute 5.2J ■ School average disciplinary climate and mathematics performance 
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1 . Response rate too low to ensure comparability. 
Source: OECD PISA 2003 Database. 


Nore: Statistically significant score point 
differences are marked in a darker tone. 
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students in Mexico and the partner countries Brazil, Thailand and Tunisia reporting the most posi- 
tive perceptions of student-teacher relations and students in Japan and Luxembourg the most nega- 
tive, Within each OECD countrv there are weak positive correlations between students’ reports on 
disciplinarv climate and student -teacher relations, thus indicating that manv students who see their 
teachers as helpful and fair also tend to report a more positive classroom disciplinarv climate. 

Fjgui-e 5.28 ■ Student-teacher relations and mathematics performance 
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1. Response rate too low to ensure comparability. 
Source: OECD PISA 2003 Database. 


Note: Statistically significant score point 
differences are marked in a darker tone. 
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Despite this, the effects of student-teacher relations on achievement are quite different from those 
of disciplinarv climate in the majority of countries, although thev are similar in Australia, New 
Zealand, Sweden, the United Kingdom and the partner economy Hong Kong-China, In 12 of the 25 
countries where the observed association between student-teacher relations and mathematics per- 
formance is positive, it becomes negative when other contextual and teaching and learning factors 

Fjgut^e 5.29 ■ Teacher support and mathematics performance 
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1. Response rate too low to ensure comparability. 




Score point difference 
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Source: OECD PISA 2003 Database. 


Note: Statistically significant score point 
differences are marked in a darker tone. 
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are taken into account. However, once other contextual and teaching and learning factors have been 
accounted for there is a positive association between student-teacher relations and mathematics per- 
formance in the United Kingdom, New Zealand, Australia, Norwav, Sweden, Denmark, Ireland, 
Canada and the partner economv Hong Kong-China (Figure 3.28). 

It is worth noting that student-teacher relations were analysed at the school level in earlier models. 
Student reports on student-teacher relations generallv showed no effect when aggregated to the 
school level, indicating that such perceptions are more student-specific than school-specific, unlike 
student reports on disciplinarv climate. 

Teacher support 

Teacher support covers areas similar to student-teacher relations. The basis of the teacher support 
index are questions on: students’ perceptions of their teachers, including items on teacher interest in 
students, whether the teacher helps students with learning and allows students to express opinions. 
Indeed, this variable has a correlation of 0.78 with student-teacher relations across OECD countries 
and there are correlations of at least 0.40 at the student level in 26 of the OECD countries. It would 
therefore be expected that this measure would not vield significant effects in the teaching and learn- 
ing analvtical model, which controls for teacher-student relations among other factors. Nevertheless, 
as Figure 3.29 indicates, there are negative effects for teacher support in 27 countries, including in 
the OECD countries where there are positive effects for student-teacher relations in the teaching and 
learning analvtical model. This result is in stark contrast to the observed associations between teacher 
support and mathematics performance: thev are negative in only the Slovak Republic, Luxembourg, 
Italv and Belgium as well as in the partner countries Serbia, Brazil and Uruguav. In fact, observed 
positive associations between teacher support and mathematics performance occur in 13 countries. 

Aggregating the measure of teacher support to the school level in earlier versions of the teaching 
and learning analvtical model Yielded few significant effects. 

The results for teacher support suggest the possibilitv that in some countries teachers give higher 
levels of support to the lowest-achieving students, a finding that makes sense if teachers are concerned 
to address the problems of such students. The shift from positive observed effects to negative effects 
in the analvtical model in Norwav, Australia, the United States, Denmark, Canada, Finland and 
New Zealand indicates that teacher support is mediated bv some of the other factors included in the 
analvtical model. As in other cases, the kev mediator seems to be self-efficacv in mathematics. The 
correlations between self-efficacv in mathematics and teacher support are generallv small but positive 
(correlations are at least 0.20 onlv in Canada, Iceland, Mexico, Norwav, the United Kingdom and the 
United States). Adding a control for self-efficacy in mathematics to the student-level bivariate model 
effectivelv changes most positive effects into negative ones. However, removing self-efficacv in math- 
ematics from the teaching and learning analvtical model results in almost no change in the effects. The 
implication of this is that much of the positive value of teacher support is a function of its joint effects 
with other factors, especiallv those that relate to self-efficacy in mathematics. 
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Other variables 


A variety of other school-level factors and student factors aggregated to the school level enter into 
the analytical model throughout its preliminarv stages of development. In particular, the analysis 
incorporated several time-related variables, including total instructional time and mathematics instruc- 
tional time, and measures of teacher innovation, expectations, streaming and assessment. In no cases 
did these contribute significantly to the predictive power of the analytical model. From an ana- 
lytical standpoint, therefore, it seems clear that maximum predictive power has been drawn from 
the teaching and learning analytical model. Nevertheless, even though the overall predictive power 
of the model is strong, especially in accounting for school-level variance, only a few of the factors 
analysed are major contributors to the prediction. 


This chapter has examined the contributions of student learning strategies and teaching strategies to 
mathematics achievement, especially those factors connected with the way in which students approach 
the learning of mathematics. Rather than emphasising variations among countries, the focus has been 
on factors that are of universal value. Manv such factors appear in the literature. These include use of 
time, attitudes and dispositions and student use of learning strategies or generic approaches to learning. 


This report uses an analytical model which treats factors such as students’ socio-economic back- 
ground and perceptions of school as antecedents to teaching and learning. The results reported for 
the teaching and learning factors analysed are therefore their unique effects after removing anv 
joint effects of the other contextual and teaching and learning factors included in the analytical 
model. This type of analytical model has the advantage of being more closely representative of the 
real world of schools and classrooms, in which all of the antecedent factors mav be considered as 
preconditions on learning. The disadvantage of this analytical model is that, in some cases, there is 
ambiguity as to what constitutes an antecedent, or indeed an outcome, and that some factors ana- 
Ivsed in the model mav mediate the effects of the main teaching and learning strategies. 


In addition to looking at the observed association between various factors and performance, and at 
the unique effects of each factor when other factors have been accounted for, it is important to con- 
sider the interaction between the different factors discussed in this chapter. A good example here is 
the relationship between self-efficacv in mathematics (students’ rating of their own effectiveness as 
learners), learning strategies and mathematics performance. In the analytical model, adjusting for 
self-efficacy in mathematics in manv cases turned the positive observed effect of adopting a learning 
strategy into a negative effect. What can be inferred from this change depends on the nature of the 
causality in the interaction between these three factors. 


HIGHLIGHTS OF THE ANALYTICAL RESULTS 

There are links between a sense of sef-fficacj and use of learning strategies. If Students’ views of their math- 
ematics abilities are simply based on how well thev do in mathematics (high performance causes 
self-efficacv), the main effect of adjusting for self-efficacv as a variable may be to mask some of the 
benefits (in terms of improved performance) of adopting effective learning strategies. In this case, 
an emphasis on the development of learning strategies such as elaborating and controlling one’s 
learning should contribute to achievement more than is implied bv their unique effects alone. If, on 
the other hand, self-efficacv is a factor that helps contribute to performance and effective learning 
strategies tend to follow from a belief in one’s efficacy in tackling mathematics problems, then the 
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emphasis in schools should be on building students’ belief in their own effectiveness. While evi- 
dence from PISA cannot distinguish between these two interpretations of the analvtical results, the 
strength of the relationship between self-efficacv and learning strategies suggests that both are valid, 
and that building up student confidence needs to go hand in hand with enabling them to develop 
strategies for effective learning. 

A strong sense one^s own ability to learn mathematics is oj key importance. Students’ self-concept in 
mathematics and self-efficacv in mathematics vield strong positive effects in all OECD countries 
where these factors are not overridden bv students’ socio-economic background, perceptions of 
school, motivation to learn or other factors. A strong sense of confidence in one’s own abilities in 
mathematics as well as a strong sense of efficacv in overcoming difficulties in learning tasks are 
both stronglv associated with mathematical competencies. Pronounced effects occur particularlv 
in Australia, New Zealand, Sweden and the United States. It is important to reiterate here that no 
causal effect can be inferred from the relationship between self-concept and self-efficacv on the one 
hand and mathematics performance on the other. It is just as plausible to infer that high performance 
vields high self-concept or self-efficacv as to infer the reverse relationship. 

The rime students invest in study in addition to their lessons is important, but mathematics learning is mainly 
school-based. In 25 of the OECD countries, the effect of hours per week of total homework on math- 
ematics performance remains positive and these effects are relatively stable compared to the observed 
associations with performance; converselv, hours per week of mathematics homework showed nega- 
tive effects in 21 of the OECD countries. (There is, however, evidence that doing some mathematics 
homework is better than doing none at all for the majoritv of OECD countries: the small proportion of 
students who reported doing no mathematics homework at all had lower mathematics performance in 
23 of the OECD countries compared to students who reported doing some mathematics homework.) 
The finding that hours per week of mathematics homework showed negative effects in inanv countries 
mav be attributed to the inclusion of mathematics homework in total homework. Indeed, mathematics 
homework makes up a substantial proportion of total homework for most students. However, when 
these results are interpreted from the perspective of the Carroll model, too much homework may 
have the effect of adding unnecessarily to time spent, so that it exceeds time needed. Taking this argu- 
ment a step further, one might hypothesise that students with higher aptitudes do not need to spend so 
much time on homework. Unfortunately, the data available do not allow the testing of this hypothesis. 
Longitudinal studies, which follow student behaviours and performance over several vears, would 
be the optimal wav to studv this issue and the cumulative nature of mathematics learning in general. 

Participating in tutoring and taking out-of-school classes in mathematics are negativelv associated 
with mathematics performance, both before and after accounting for other contextual and teaching 
and learning factors. A common-sense interpretation of this finding is that students who engage 
in these activities tend to be performing less well in school compared to other students and do 
not improve sufficiently thanks to these activities to be among the better performers in the PISA 
mathematics assessment. This interpretation does not implv that these students do not benefit from 
participating in studv organised outside school. The analvsis supports this view bv the generally 
small negative correlations between these activities and PISA performance. A second interpretation 
could be that these activities are narrow in scope, and although they may have positive effects on 
the students’ school performance, these students are nevertheless more challenged bv the general 
mathematical literacv that PISA measures. 
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Students’ use oj learning strategies show different associations with mathematics pe^ormance across countries, 
hut when other contextual and teaching and learning Jactors are accounted Jor, the use oJ memorisation/ 
rehearsal and elaboration strategies are negatively associated with performance in the majority oJ countries. The 
measures of learning strategies generally behave differently in the teaching and learning analytical 
model compared with their observed effects. In all OECD countries with significant effects, the 
use of elaboration strategies and memorisation/rehearsal strategies is negatively associated with 
mathematics performance. However, the use of control strategies is not associated with mathematics 
performance in the majority of countries, although there are weak positive effects in New Zealand, 
Portugal, Australia, Canada, Korea, Turkey, Spain, and in the partner economy Hong Kong-China, 
and weak negative effects in nine countries. 

Preferences for either co-operative or competitive learning situations are not strongly associated with 
mathematics performance once other contextual and teaching and learning factors are accounted 
for. However, there is an observed positive association between a preference for competitive learn- 
ing situations and mathematics performance in 29 countries, but in the teaching and learning model 
the only country where the positive association remains is Denmark. In Japan, Hungary, Finland 
and Switzerland, a preference for co-operative learning situations shows small positive effects in the 
teaching and learning model; interestingly, among these countries, the observed association with 
performance is only positive in Japan. Although it is possible to advance arguments about school or 
societal influences on student dispositions in these areas, the effects are not clear enough to draw any 
conclusions about whether either of these approaches should be encouraged bv schools and teachers. 

A strong disciplinary climate is strongly and positively associated with mathematics perjormance. The notable 
exception to the pattern of small and inconsistent effects for teaching and learning strategies is the 
result for disciplinary climate. Positive disciplinary climate shows positive effects on achievement 
for all countries at either the student or school level, and at both levels for the majority of countries, 
no matter how the analytical model is structured. Indeed, the average school-level disciplinary 
climate exerts independent positive effects from those found for student -level disciplinary climate. 
This finding has important implications because school-level disciplinary climate is something that 
can potentially be addressed bv school-level policies. While school-level disciplinary climate mav 
relate to such factors as the socio-economic composition of the school, PISA results indicate that 
improving disciplinary climate seems to be a universally valid wav to improve achievement. Looked 
at another wav, lost learning time in school mathematics classes is strongly associated with lower 
mathematics performance. 

The socio-economic composition oJ the school and students’ sense oJ self-fficacy in mathematics generally show 
the strongest associations with mathematics perjormance. In 18 of the countries studied, the socio-eco- 
nomic composition of the school has stronger associations with mathematics performance than any 
of the teaching and learning factors analysed. In 15 of the countries, self-efficacv in mathematics 
has the strongest association with mathematics performance. In Finland, Denmark, Iceland and 
Australia, students’ self-concept in mathematics shows the strongest association with mathematics 
performance. Among the teaching and learning factors analysed, disciplinary climate at the student 
and school levels and hours per week of homework in total stand out as having the strongest unique 
effects across the majority of countries, with student use of control strategies and student-teacher 
relations having positive associations with mathematics performance in some countries but not in 
others. 
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Chapter 3 has presented the results of multi-level modelling that measures selected features of 
teaching and learning effects on performance in mathematics after adjusting for other character- 
istics of students and schools. The next chapter examines some of the policy implications of the 
results and provides observations for the design of future PISA surveys. 


Notes 


1 Three of the PISA 2003 participating countries are excluded from parts of this analysis. School-level analysis for 
France is not presented in this report; Indonesia has too much missing data on the measures included in the ana- 
lytical model; and results for Liechtenstein are not reliable in two-level models, as there are too few participating 
schools. 

2 Initially, correlations among measures were examined and several versions of the analytical model drawn up and 
examined, using different combinations of measures. Because some of the measures (predictors) were highly 
intercorrelated or were found to have only small correlations with achievement, not all of the measures of poten- 
tial analytical interest were included in the final model. 

5 A significant concern in building multiple regression models such as those used here is that the measures or pre- 
dictors are often correlated with each other, and in complex patterns. This means that the impact of a particular 
variable on the outcome (in this case on mathematics achievement) depends not only on the correlation of that 
variable with achievement but also on which other variables are included in the model and on how these are 
correlated with the particular variable of interest. Under certain circumstances, the effects found in a multiple 
regression model may be quite different from those found in a simple correlational model. The effects reported 
here are the unique effects of each variable of interest, adjusting for all other variables in the model. Using dif- 
ferent combinations of variables in different versions of the model can help determine if the effects of a particular 
variable are being mediated, or even suppressed, by particular other variables. Mediation or suppression refers to 
a situation in which two or more variables are associated with the outcome and also with each other. Taken one 
at a time in a model, such variables may appear to be good predictors of the outcome. However, when taken in 
combination in a more comprehensive model, the effects of one variable may override the effects of others. 

For example, the two socio-economic background variables — parent occupation and parent education — tend to 
be highly correlated with each other. Taken separately, each is also typically a good predictor of achievement. 
However, when taken together, the first of these to be entered into the model is likely to account for most of the 
variability in achievement, and hence mediates or suppresses the effect of the second variable. The effect of the 
second variable is essentially subsumed by that of the first. One hypothesis tested in developing the model was 
that students’ own confidence in their mathematical ability (self-efficacy in mathematics) was such a strong influ- 
ence on achievement, and so closely correlated with teaching and learning variables, that it would suppress other 
observed effects. In fact, very little difference was found in the magnitude of the effects according to whether 
or not students’ self-efficacv in mathematics was included as a background variable. The effects of this variable 
could therefore be treated as independent of the effects of other variables. While it would have been desirable to 
examine many other model combinations as a way of probing these effects further, this complicates the presenta- 
tion significantly when the model contains many variables. 

An argument can be made that the unique effects of teaching and learning, rather than those mediated bv factors 
such as student background, are of most interest from the perspective of policy and practice, because teaching 
and learning takes place in an overall context that cannot easily be controlled by teachers or students. However, 
it can also be argued that broader policies could be influenced by knowledge of mediating effects, because these 
may be a consequence of particular ways of organising schools or classrooms. It is also possible that one aspect of 
teaching and learning can mediate another, and thus there is scope for looking at two or more aspects together as 
part of an overall teaching and learning strategy. 
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A simple example of possible mediating effects in this study arises from the composition of the variables “total 
homework” and “mathematics homework”. Because the former includes the latter, these two variables are obvi- 
ously correlated. The size of the correlation will depend partly on the proportion of total homework that is math- 
ematics homework. On the one hand, the actual correlation between these variables is in the 0.60 range in most 
countries, which is verv high compared to most other correlations of interest here. Intuitivelv, one might expect 
mathematics homework to be more highly correlated with mathematics achievement than total homework. On 
the other hand, total homework mav be an indicator of a more general propensity to attend to school work, and 
thus might be independently correlated with mathematics achievement. Once the two variables are included in 
the model, the effect of one may be mediated or suppressed bv the other. As it happens, this is not what occurs 
in this case. Nevertheless, this example illustrates in a straightforward way the difficulties in interpreting model 
effects. 


4 The order of entry of the measures analysed is more of an issue when a stepwise analysis is undertaken, that is, 
when measures are entered in order of relative predictive power. 

5 The estimate of the number of books in the home was used directly as it proyed to be a better predictor of 
achievement than the index of cukuml possessions. 

6 Across OECD countries on average the latent correlations among the three measures are: -0.80 for self-concept 
in mathematics and anxiety in mathematics; -0.52 for self-efficacv in mathematics and anxiety in mathematics; 
and 0.62 for self-concept in mathematics and self-efficacy in mathematics (Table A. 2). 

7 On average across the OECD countries, the correlation between participation in tutoring and both the highest 
parental occupation and educational level is 0.04, and the correlation between participation in out-of-school les- 
sons and both the highest parental occupation and educational level is 0.02. 

8 The correlation between the observed effects and the analytical effects for students’ use of memorisation/ 
rehearsal strategies is 0.58. 

9 This was tested by constructing one composite index that simply combines responses to all of the items making 
up the three indices for student learning strategies. This composite yielded close to a normal distribution, indi- 
cating that the problem is not that of a halo effect or the tendency of students to respond in a similar way to all 
items in a set. The country-level correlations for the composite were mixed — positive and negative — indicating 
that the effect of the composite is no more universal than that of the individual components. 

10 The PISA school questionnaire contains a number of indices of school climate. However, examination of these 
indices was considered beyond the scope of this study because thev could not be clearly identified with teaching 
strategies. 

11 Exploratory analysis was undertaken using observed variables within selected PISA indices instead of the PISA 
indices themselves. Other than the variable number ojbooks in (he home, none of these variables contributed more 
to the predictive power of the analytical model than the composite PISA indices. 
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This chapter summarises the main results oj the report, ident^ies relevant issues JorJurther 
research and development (^PISA, and examines the extent to which the available results 
speak to the relevant issues. For many the variables explored, country d^erences stand 
out so much that their effects maj be best interpreted ivithin countries or clusters of coun- 
tries with similar cultural backgrounds or school systems. 
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INTRODUCTION 


This chapter offers a stand-alone overview of the report. It summarises the main results, identifies 
relevant issues of policv and practice and examines the extent to which the results available address 
these issues. It also considers the design of PISA in the light of interpretation issues encountered in 
this study. 

The analvsis in this report contributes to understanding: 

■ The d^erences between teaching and learning practices in d^erent countries, thus allowing countries to 
benchmark practices. Some of the descriptive data are therefore of interest, for example in compar- 
ing homework practices across education svstems. Such comparisons need, however, to be made 
with caution, especiallv when comparing statements made bv principals and students that require 
a degree of interpretation {e.g. how much certain learning strategies are emploved) and where 
response bias can arise because of different cultural contexts. 

■ The extent to which teaching and learning practices vary across schools within each country. This area is the 
principal focus of Chapter 2 and is an important concern in education svstems that aim to provide 
equalitv of opportunitv to all students. 

■ The extent to which individual aspects oj teaching and learning are associated with better or worse perform- 
ance. These associations are difficult to identifv because of the complexitv of interactions between 
various factors, as well as the interaction of different factors with student characteristics such 
as socio-economic background or students’ belief in their own efficaev. Nevertheless, taken 
together, it is clear that teaching and learning factors have a significant association with student 
performance in mathematics. 

It is important to recognise that teaching is a complex activitv and that an enormous number of 
variables, manv of which are outside the control of schools or teachers, influence learning. Even the 
most carefullv designed studies, such as PISA, cannot be expected to identifv a few simple school or 
classroom practices that, if implemented, would make a major difference to student learning. This 
argument is especiallv true here since even the best cross-sectional survey cannot yield a cumulative 
picture of the school and classroom experience of students near the end of their compulsorv school 
careers. Estimates of school and teaching effects in a cross-sectional studv are, at best, a one-year 
snapshot, while the effects of home background and attitudes are likelv to be more stable. Survevs 
can indicate particular areas of interest and mav in a few instances, such as for disciplinarv climate 
in this report, identifv a factor which appears to have universal positive or negative effects on 
performance. However, manv teaching and learning factors are likelv to interact with each other 
and with the cultural climate in particular countries to vield different impacts in different countries. 
It is clear that the teaching and learning factors measured in PISA show more than random effects 
on mathematics achievement. However, it is equallv clear that these effects are not universallv in 
the same direction or of similar magnitude across countries. Countrv differences stand out for 
manv of these variables, to the extent that analvsis within countries or clusters of countries with 
similar cultural backgrounds or school svstems mav provide the best interpretation of their effects. 
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BACKGROUND FACTORS THAT PROVIDE THE CONTEXT FOR TEACHING AND 
LEARNING 



The place of socio-economic status 

This report does not directly focus on socio-economic background. Nevertheless, the PISA results 
clearlv show that socio-economic background plavs a major role in determining the achievement 
levels of students. Much of the analytical work using the PISA data has addressed the impact of 
socio-economic background on achievement. While socio-economic background is a more-or-less 
fixed background factor which education systems can do little to influence directly, the biggest 
long-term social change that schools can accomplish is to help children overcome the disadvantages 
of their backgrounds and hence facilitate social mobility. 

The immediate implication of this finding for the analysis in this report is that the impact of teach- 
ing and learning strategies needs examination independently of students’ backgrounds. Thus the 
design of the models developed here aims to adjust for socio-economic background when exam- 
ining the effects of teaching and learning strategies. Ideally, the use of appropriate teaching and 
learning strategies moderates the impact of socio-economic background on achievement, and 
many educational policy initiatives are intended to compensate for adverse socio-economic effects. 
Nevertheless, the models used here make clear that socio-economic background remains one of the 
strongest predictors of achievement, even in the presence of a large variety of teaching and learning 
strategy variables. That is, the teaching and learning variables examined here do not seem in prac- 
tice to mitigate very much the disadvantaged social backgrounds of some students. 


Student attitudes, motivations and self-concept 

Like socio-economic status, students’ self-confidence and motivation as learners show consist- 
ent correlations with achievement. These factors could also be related to teaching and learning 
strategies, and therefore thev are included as control variables in the models. Nevertheless, unlike 
socio-economic background, the direction of causation is not at all clear for these variables. That 
is, it is possible that attitudes can be influenced bv teaching strategies, that attitudes influence 
learning strategies or that attitudes are affected bv achievement. For example, the question remains 
unresolved of whether a high level of perceived competence in mathematics precedes or follows 
a high level of achievement, or whether low achievement engenders high mathematics anxiety or 
vice versa. As noted earlier, cultural differences are likely to affect students’ interpretation of self- 
confidence and motivation questions. Results in these areas should be interpreted with country dif- 
ferences in their mean index values in mind. Readers familiar with particular countries or cultures 
are better placed than the authors to make judgments about such differences. These variables show 
some unexpected patterns when taken in the context of other factors in the full model and hence 
warrant further discussion. 


Self-efficacv is often seen as a major determinant of behaviour (Bandura, 1993). However, there is 
some debate as to whether self-efficacv is best thought of as a generic or a subject-specific trait. The 
extent of its correlation with achievement seems to depend on the type of self-efficacv measure used 
(Moulton, Brown and Lent, 1991). PISA 2003 measures self-efficacv, specifically as a mathematics 
trait, using items in which students evaluate their competence at solving a variety of mathematics 
problems, yielding the index of self-efficacv in mathematics. Countries in which students have a 
greater sense of self-efficacy tend to have higher performance, while within most countries there 
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is a correlation with performance that remains even when adjusting for other factors.The average 
sense of self-efficacv (set as zero internationallv) varies considerablv across countries. In the Slovak 
Republic students overall have self-efficacy half a standard deviation above average, while those 
in Japan and Korea, and the partner countrv Thailand, are the same amount below average. In 
countries where students have least confidence in their own efficacv, this variable also makes least 
difference to their predicted achievement; it is most closelv correlated in some countries that have 
about average self-efficacv overall. 

The question arises of whether there would be anv benefit in attempting to enhance self-efficacv 
in mathematics as a means of improving achievement. PISA cannot show whether this would be 
effective, but the question does highlight a pertinent cultural issue. Students in Japan and Korea 
have among the lowest average sense of self-efficacv in mathematics, though both countries have 
among the highest average achievement levels. This finding raises the further question of whether 
the culture or the school svstems of these countries are in some wav engendering more negative 
student opinions of their mathematics competence than the realitv of their achievement warrants. 

Another affective variable showing wide differences across countries is anxietv in mathematics. 
Students in Mexico, Japan and Korea, and the partner countries Tunisia, Brazil and Thailand (a 
contrasting mix of high- and low-achieving countries), express particularlv high levels of anxietv 
about mathematics. However, in Denmark, Finland, the Netherlands and Sweden (all relatively 
high-achieving countries) students show particularlv low anxietv. Both within and across countries, 
students who are anxious about learning mathematics tend to perform worse in the subject. Again, 
there mav be lessons for teachers here, especially in countries where anxietv is highest, to make 
more efforts to reduce it. Particularlv in Mexico and the partner countrv Brazil, high anxietv tends 
to go with low mathematics performance. 

PISA also gives some indication to teachers that students’ motivation is an important aspect of their 
learning. When asked about their motivation to learn mathematics — out of interest or for more 
instrumental reasons — students once again responded differently across countries. Although cul- 
tural differences mav influence the wav students respond to this question across countries, within 
countries those with the highest motivation perform best on average (there is a moderate correlation 
between motivation and performance). 

Much of the research on efficacv, attitudes and motivation hinges on the working hypothesis that 
high values of such variables are associated with high achievement (e.^. Baumert and Koeller, 1998; 
Aitken, 1974; Lepper, 1988; Wigfield, Eccles and Rodriguez, 1998; Moulton, Brown and Lent, 
1991; Branden, 1994). However, some sources suggest that the relationship between these factors 
and achievement is subtler and more indirect than the simple hypothesis would indicate. This studv 
strongly reinforces that view. While most of the bivariate relationships operate in the predicted 
direction when examined within countries, there is an obvious country-specific component in the 
patterns. For example, students in several high-achieving countries, particularlv Asian ones, show 
a generally negative sense of self-efficacv and have relatively negative attitudes and motivations. 
The existence of negative between-countrv effects suggests that country-specific features strongly 
influence the measurement of these factors. Even within countries, however, positive associations 
between certain attitudes and performance sometimes become negative when adjusting for other 
factors. 
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Common-sense logic dictates that teaching can and should influence such attitudes and motiva- 
tions. If, in their turn, these factors influence achievement, it might be desirable to direct teaching 
strategies towards improving attitudes and motivations in the hope that this would have indirect 
positive effects on achievement. While there is no wav of measuring the extent to which teachers 
deliberateiv aim to improve attitudes in order to improve achievement, in practice there is a con- 
sistent bivariate association between good student attitudes and the adoption of helpful teaching 
strategies, for example by creating a positive classroom climate. This finding needs to be interpreted 
with caution, however, since teaching strategies in PISA are rated bv students, and it is possible that 
those who have positive views of what their teachers are doing also tend to have positive attitudes 
in general. Nevertheless, it seems that there is little to be lost in having teachers act in wavs that 
help reduce mathematics anxietv and increase students’ sense of self-efficacy in mathematics and 
their self-concept. However, teachers should also note that students who enjov mathematics or feel 
a sense of belonging at school actuallv tend to perform worse in mathematics when adjusting for all 
other factors. This evidence does not mean that enjoying mathematics causes students to perform 
worse, but that a student who enjovs mathematics more than another will not necessarilv perform 
better if she does not also have other characteristics that tend to go with enjovment, such as greater 
confidence in her mathematics abilitv. 


Time allocations 

Since Carroll’s groundbreaking 1963 paper, time allocation has become one of the most significant 
variables in studies of achievement. Although Carroll suggested in his 1989 retrospective that he 
had not done much more than state the obvious, his model took the analvsis of time well bevond 
the common-sense notions that no learning can take place without spending time and that more 
time should lead to greater learning. In particular, the distinction between time allocated and time 
needed, and the relationship of these variables to student aptitude, qualitv of instruction, opportunity 
to learn and perseverance have become established elements in the analvsis of time and its impact on 
learning. One can think of this model, therefore, as capturing teaching and learning strategies within 
a framework in which more effective strategies either decrease time needed or increase time spent 
(through longer periods of instruction or more out-of-class learning). 

For school authorities, the length of the school vear and school dav are the most salient time vari- 
ables. States can also regulate other aspects of time, such as time allocations to particular subjects 
or the length of class periods, although the school often decides these matters. Depending on the 
degree of centralisation of the system, schools can treat state-level time policies as guidelines or as 
definitive allocations. Since PISA 2003 did not measure jurisdictional-level variables directlv, the 
information on global time allocations available comes from the school questionnaire and hence 
reflects variations among schools. 

The number of weeks in the school vear varies considerablv in countries taking part in PISA, with 
a norm of 36-40 weeks, but onlv 33 weeks in Ireland, 32 in the partner countrv Tunisia and 24 
in Mexico. These countrv differences do have a positive correlation with performance, but within 
countries, the correlation is mostlv negative, although weak — probably because of limited within- 
countrv variation and the influence of a few outlier schools. A second time measure, the length of 
the school week, shows greater variation than the school vear within some countries, especiallv 
in the United States, although in Finland and the partner countrv Latvia, for example, neither the 
school week nor the school vear varv much. In these countries, therefore, the main correlation with 
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performance is within countries, although when adjusting for other factors the correlation tends 
not to be significant. Similar results applv for the quantity of mathematics teaching, even though 
here country differences are striking: the partner economies Hong Kong-China and Macao-China 
provide over 4.5 hours of mathematics instruction each week to 15-vear-olds, whereas Finland 
provides only 2.5 hours. 

These results suggest that giving more overall time to mathematics instruction does not greatly con- 
tribute to better achievement. While this does not negate the value of time spent on mathematics 
learning, it does suggest that other intervening variables can offset anv advantages of longer overall 
time allocations. This area requires further investigation within some countries, particularly those 
with very low time allocations and verv low achievement. 

STUDENT LEARNING STRATEGIES 
Student use of time 

The Carroll model addresses time use at the level of the individual. Total allocated learning time in 
the school is only one aspect of this model. While this aspect might be a limiting factor on learning, 
the reality is that students mav fail either to use all of the instructional time available or mav find 
wavs to extend this time. PISA does not investigate lost time in anv comprehensive wav (although 
the issue is touched on when looking at classroom climate, where students are asked, for example, 
whether at least five minutes at the start of lessons are spent doing nothing). However, PISA does 
measure additional time spent on learning using questions on exposure to tutoring and other out- 
of-class instruction and on time spent on homework. 

The proportion of students tutored in mathematics is in the 10% to 20% range for most countries. 
It is less than 10% in several high-achieving countries such as Belgium, Finland and japan, but 
exceeds 30% in some low-achieving countries, particularly Greece, Mexico and Turkey. Patterns 
of out-of-class lessons are similar. However, in both cases it is difficult to find positive effects on 
learning — although the literature suggests these positive effects do exist (Cohen, Kulik and Kulik, 
1982; Hattie, 1992) — because those who receive such extra support mav be more likely to be less 
able students. Indeed, there is generally a strong negative correlation between participation in such 
activities and achievement in mathematics. The prevalence of tutoring and extra lessons in some 
low-achieving countries suggests that extra efforts are being made bv manv students and bv their 
parents (who must pav for such services) to overcome low achievement. However, these efforts are 
clearly not yielding sufficient pavoff to raise achievement levels significantly for the country as a 
whole. The obvious policy implication is that countries cannot relv on services provided outside the 
school setting to overcome those characteristics of their school systems or of their societies that are 
contributing to low achievement. Taking this argument a step further, it is possible that the value of 
extra-school instruction is being oversold by a large and growing industry. 

Several other related issues follow from these results. It is particularly important to investigate 
whether students from more affluent families are taking tutoring and out-of-class lessons. The 
results indicate that there is a small positive relationship between socio-economic background and 
these activities. It is not clear if the high prevalence of these activities in some countries is related 
to the cost of such services, to such factors as the availability of qualified but unemployed personnel 
and to whether regular teachers engage in such activities after school hours, perhaps to supplement 
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low salaries. It is also unclear whether the high proportions recorded in some countries simply rep- 
resent over-reporting. These points warrant detailed investigation in the light of the mixed results 
on whether the impact of extra learning on individual students is positive, especially in countries 
with low average achievement and where these activities are prevalent. 


The second major area of student use of time measured in PISA is homework. There is substan- 
tial support in the literature for the value of homework as a contributor to achievement (Paschal, 
Weinstein and Walberg, 1984; Hattie, 1992; Cooper, Robinson and Patall, 2006) when the home- 
work assignment reinforces the material that has been learnt, rather than being given in place 
of instruction. However, a report bv Mullis et al. (2000), based on the lEA Third International 
Mathematics and Science Study (TIMSS), found that homework time was a negative predictor of 
mathematics and science achievement. 


The PISA student questionnaire contains items on hours per week spent on all homework and on 
mathematics homework. As with tutoring and extra classes, the assignment of homework occurs 
more in countries with lower overall achievement. However, in the case of homework, unlike with 
tutoring, the evidence suggests an overall beneficial effect within countries. Even adjusting for 
other variables, total homework time shows significant positive effects on achievement for almost 
all countries, although the effects for mathematics homework are mainly significantly negative. A 
kev finding that helps explain the latter result is that the small proportion of students reporting no 
mathematics homework tend to have higher achievement than those reporting some mathematics 
homework. This evidence indicates that some students can learn mathematics effectively through 
their within-school work and thus have no need for homework. 


All of this presents a complex picture for the effect of homework. Negative countrv-level correla- 
tions and the inordinate amount of time spent bv students in some low-achieving countries on 
homework suggest that homework is being used to compensate, but not verv effectively, for the 
limitations of schooling or to substitute for instruction bv teachers. It also seems likelv that in many 
high-achieving countries, and for high-achieving students in all countries, the current approach 
to teaching mathematics in school is sufficient to allow students to function well without much 
homework. However, it is clear that within each country, higher-achieving students do more total 
homework than other students. 


The policy implications of these results are not straightforward. A general argument can be made, 
based on these results and on the literature, that schools and school systems should encourage 
homework. However, further investigation is required to determine if homework is being used to 
offset problems occurring within schools and on the effectiveness of homework for low-achieving 
students. More specifically, it would be useful to know what particular forms of homework students 
are doing and whether teachers primarily assign homework as specific tasks or as a general require- 
ment to practise certain topics. 


Meta-cognitive strategies 

Meta-cognitive strategies are generic approaches that students use in addressing a learning task. 
There is support in the literature for the hypothesis that student use of meta-cognitive strategies 
contributes to achievement. Indeed, this is one of the proximal areas considered bv Wang, Haertel 
and Walberg (1994) as having the greatest influence on achievement. 
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The three index variables used in PISA are memorisation /rehearsal, elaboration strategies and 
control strategies. Memorisation involves activities such as going through examples repeatedlv and 
trving to remember all of the steps in a procedure. Elaboration is associated with activities such as 
thinking of new ways to solve a problem and relating the problem to existing knowledge. Control 
strategies involve trving to discern what are the important parts of a problem and working out what 
needs to be learnt. Although memorisation has been widelv investigated bv psvchologists, todav thev 
generallv regard it as a low-level strategv, associated with a behaviourist approach to learning, and 
hence it is often discouraged as a general strategv for school learning. Elaboration is a more compre- 
hensive strategv, consistent with the more constructivist view of learning now prevalent, especiallv 
in teacher education programmes. Control strategies seem to relate to efficiencv in learning, though 
it is more difficult to situate such strategies within any particular psvchological framework. 

Consistent with expectations, memorisation strategies tend to be less frequentlv used than either 
elaboration or control strategies. They tend to be used more bv students in relativelv low-perform- 
ing countries: students in Mexico, Brazil, Thailand and Tunisia say that they use memorisation the 
most, which produces a verv high negative correlation between countries’ use of memorisation and 
their performance in PISA. The within-countrv correlations with achievement are mostlv close to 
zero, but with a few significant positive and negative values. 

It must therefore be concluded that memorisation is an ineffective strategy. This finding has impor- 
tant implications for policy and practice in some of the lowest-achieving countries, where students 
relv extensivelv on memorisation. It is clear that teachers need to find wavs to enable students to 
reduce their reliance on memorv. One possible approach is to teach generic strategies for attacking 
mathematics problems: to teach methods, not a memorisable body of information. 

The report suggests that the index of elaboration strategies can be an indicator of whether students use 
such generic strategies, though not of whether students have learned these methods from teachers 
directlv. While students use elaboration strategies more often than memorisation strategies in most 
countries, the patterns of relationship with achievement are similar. On the standard scale, stu- 
dents in Mexico and Turkcv, and the partner countries Brazil, Serbia, Thailand and Tunisia, show 
the highest positive levels of use of elaboration strategies, while those in Japan and Korea show the 
highest negative levels. Within-countrv correlations are mostlv small but the between-country cor- 
relation is stronglv negative. This evidence suggests that those countries using memorisation are not 
doing so at the cost of elaboration, but it is also possible that cultural bias affects responses to these 
questions, and in particular that students in some countries are generallv more inclined to agree 
with statements of this tvpe, whatever their actual learning habits. 

This tendencv would seem to be confirmed bv students’ self-reports on use of control strategies: 
students in Mexico and the partner countries Tunisia and Brazil, along with those in Austria and the 
partner countrv Serbia, were the most likelv to sav thev controlled their learning. Control strategies 
differ from the other two meta-cognitive strategies in that, in some countries, there is a correlation 
between adopting such strategies and performance even after adjusting for other factors. However, 
this applies to onlv one -half of these countries, and the correlation is negative as often as positive. 

One possible explanation for the limited degree to which control strategies have unique effects 
on performance after accounting for other factors is that one of the variables controlled for is self- 
efficacy in mathematics. The hvpothesis here is that students with higher levels of self-efficacv are 
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more likely to use elaboration and control strategies and that these act jointly to influence achieye- 
inent. In fact, all three meta-cognitive strategies are found to correlate positiyely with self-efficacy, 
and the impact of adjusting for self-efficacy is to change biyariate positiye effects for all three 
meta-cognitive strategies into negative effects in the joint model. If, as seems plausible, adopting an 
effective learning strategy results in both greater confidence in mathematical efficacy and higher 
mathematical achievement, by adjusting for self-efficacv the possible benefits of such strategies may 
be masked. This issue could be investigated by treating self-efficacy as the outcome variable, adjust- 
ing for achievement, and comparing the modelled effects of the meta-cognitive variables on that 
outcome with those for achievement. 


It is difficult to know how to interpret these results. They are clearlv inconsistent with the literature 
as they show only small and inconsistent bivariate effects and mainly negative effects on achieve- 
ment when other variables are controlled. In fact, these three variables are highly intercorrelated, 
suggesting that the concept of meta-cognitive strategies has only one dimension. However, if this 
is so, it could be argued that a specific strategy adopted on its own will not make a significant dif- 
ference to achievement. 

These variables are clearlv more complex than expected, both from an international perspective and 
when examined in the presence of other factors. In particular, the between-countrv correlations 
again suggest a generalised response bias under which students in high-achieving countries report 
low level of use of such strategies and those in many low-achieving countries hold what mav be an 
overly optimistic view of how much they elaborate and control their learning. 

Educators who intuitively perceive the usefulness of these learning strategies would like a clear 
statement for policy makers and practitioners which savs that encouraging, or perhaps even explic- 
itly teaching, the use of meta-cognitive strategies will enhance student achievement. However, the 
results of this study do not unequivocally support such a statement, particularly as student percep- 
tions of use of these strategies are measured here, rather than actual approaches to teaching. 


Co-operative and competitive learning situations 

A substantial literature exists on co-operative learning in classrooms (see, for example, Slavin, 
1994; Johnson and Johnson, 1989). Entire programmes operate that are built around the notion 
that working in co-operative groups can enhance student achievement and social skills. On the 
one hand, there has been little in-depth investigation into the alternative approach of engendering 
competitive learning environments and, indeed, this tvpe of investigation seems inconsistent with 
the ethos of many school systems. On the other hand, at levels bevond those in which universal 
participation is expected (the tertiary level in some countries but the secondary level in others), 
competition for places can be extreme. 

The PISA index oj co-operative learning strategies and the PISA index oj competitive learning strategies derive 
from student responses to items on whether thev prefer working with others or helping others or 
whether thev want to be the best or do better than others. Overall, a majority of students in most 
countries tend to agree with statements reflecting both of these strategies, suggesting that thev mav 
not be opposites on a single continuum. Indeed, these indices correlate positively with each other 
in most countries. Students in Japan show much less enthusiasm for either strategy than elsewhere 
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in the OECD, while students in Turkey and in the partner countries Brazil and Tunisia are strongly 
positWe on both. 

Students who engage in competitiye learning tend in many countries to be among the higher achiey- 
ers, but this effect mainly disappears once one accounts for other characteristics of these students. 
Co-operatiye learning does not correlate with achieyement at either leyel. This finding suggests that 
while achieyement can predict student learning styles to some extent (high achieyers may compete 
more, because they also haye other characteristics such as confidence in their abilities), there is no 
eyidence to indicate that a particular learning style is more effectiye. In interpreting these limited 
findings about competition and co-operation, it is important to note that what are being measured 
are student preferences for these strategies and not classroom organisation or instruction in refer- 
ence to them. Moreoyer, the tendency for students to express enthusiasm for these strategies in 
some countries with low ayerage achieyement, where students also tend to be enthusiastic about 
other learning strategies, suggests a cultural bias that makes it hard to draw firm conclusions. 


TEACHING STRATEGIES 

Disciplinary climate 

Across countries, disciplinary climate is the teaching and learning factor with the strongest correla- 
tion with performance and this correlation remains positiye and significant in most countries eyen 
after adjusting for other factors. 

Disciplinary climate refers to the creation of a classroom atmosphere that is conduciye to learning. 
More specifically, it refers to a classroom that is efficient, free of disruptions and in which on-task 
behayiour is maximised. Despite the common-sense significance of disciplinary climate and its 
public yisibility as an issue in schooling, it has not been widely inyestigated in studies of teaching. 
Howeyer, studies of time on task (Denham and Lieberman, 1980), classroom distractions (Behnke 
et. al., 1981) and teacher control (Crocker and Brooker, 1986) do address elements of disciplinary 
climate. Effectiye classroom management is one of the factors identified in a recent reyiew of 
Marzano’s (2003) reyiew “What Works in Schools.” 

The PISA index oj disciplinary climate consists of items in which students are asked to report the fre- 
quency with which negatiye behayiours occur in their mathematics classrooms. Examples include: 
students not listening to the teacher, noise and disorder in the classroom, waiting for a long time for 
lessons to start or for students to quieten down, and student inability to work well in the classroom. 

The proportion of students indicating that these things occur in most or all lessons tend to be in the 
20% to 40% range. The most positiye disciplinary climates are in Japan and the partner country 
the Russian Federation, and the most negatiye in the partner country Brazil, but oyerall the ayerage 
scores on this yariable do not differ greatly across countries. 

By contrast, within-country differences in disciplinary climate are a key issue. One of the most 
important findings in this study is that not only is disciplinary climate the teaching and learning 
factor with the closest link to performance, but it is also one in which differences across schools 
are particularly high. (Although reported by students, this factor is aggregated to the school leyel). 
Moreoyer, the correlation between disciplinary climate and achieyement is much higher at the 
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school than at the student level. These results show that if school systems are to provide equal learn- 
ing opportunities to all of their students, it is very important to improve the disciplinary climate in 
those schools where it is poor. 


Teacher support and studenMeacher relations 

The index oj teacher support derives from items concerning whether the teacher shows an interest in 
student work, helps students with their learning and allows students to express opinions. A majority 
of students in most countries are of the view that their teachers act in these wavs. However, there is 
more variation across countries in this factor than in disciplinary climate. The highest average levels 
of teacher support occur in Mexico and Turkey and in the partner countries Thailand and Brazil, 
while the lowest levels occur in Austria, Japan, Luxembourg and Germany. Teacher support mainly 
correlates negatively with achievement within countries and most of the model effects are negative, 
suggesting that support is intentionally targeted towards weaker students. 

Although considered in PISA to be an aspect of school climate rather than of teaching strategies, the 
index of student-teacher relations consists of items that closelv resemble those for teacher support, con- 
cerning how well students get along with teachers, whether teachers listen to students and whether 
teachers treat students fairlv. 

The response patterns are similar for these two variables. Most of the within-countrv correlations 
are either significantly negative or close to zero. However, the model effects are more mixed. 
Several western European countries show positive effects for student-teacher relations while several 
eastern European countries, along with Mexico and the partner countries Thailand and Tunisia, 
show negative effects. 

Teacher support and student -teacher relations may be thought of as affective counterparts to the 
management emphasis reflected in disciplinary climate. Soar and Soar (1979) are among the few 
researchers to have examined emotional climate in the classroom in relation to achievement. Their 
research reports a non-linear relationship, with negative emotional climate (e.y. criticism, student 
resistance) yielding negative results but positive emotional climate not yielding the expected positive 
effect on student achievement. It is possible to infer from the Soar and Soar studies that an emo- 
tional climate that is free of the most negative features, combined with strong teacher management 
behaviours {e.^. setting limits on student movement and disruption), yields the highest achievement 
levels. 

The results for these teaching strategy variables are consistent with the literature and have direct 
implications for teaching practice. Teachers who create classroom conditions that are free of dis- 
ruptions and lost time can expect better student performance than those who do not. Teachers 
who exhibit high levels of warmth or positive affect towards students are not likelv to have higher- 
achieving students than those teachers showing less positive feelings towards their students. School 
administrators need to identify classrooms with frequent negative behaviours and take steps to 
improve the management skills of teachers in these classrooms. Identifying whole schools with such 
problems and helping them to address them are tasks for higher-level education authorities. 

All of this analysis provides specific directions for change in what might be an important component 
of a school improvement plan. However, the results need to be differentiated further to determine 
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if the observed effects are universal or are applicable to schools that are not average in terms of Stu- 
dent abilitv, socio-economic background or other characteristics. It is also important to note that 
most of the studies of discipline and affect occur at lower grade-levels than those in PISA. The con- 
sistencv in general pattern suggests common aspects of good teaching and not grade-specific effects. 


WHAT DOES THE EVIDENCE SAY? 

Table 4.1 gives a summarv of the range and variation of values of the main teaching and learning 
variables studied here, their univariate and multivariate effects and the interpretations and policv 
implications that one can drawn from the results. 

The results clearlv show wide variations among countries in the average values of the variables of 
interest and in the diversitv among schools of values of these variables. There seems to be some 
evidence of clustering of countries with similar cultural features or with similar school systems. 
For example, a few countries show consistent patterns of high diversitv across schools, suggesting a 
highlv decentralised school system. However, the degree of diversitv across schools does not seem 
to be clearlv linked to mathematics achievement. In some cases, the results indicate interesting 
teaching and learning patterns, such as the relativelv high homework levels in some low-achieving 
countries, which appear to conflict with the overall average effects for these variables across all 
the countries studied. In other cases, such as the high level of memorisation found in some low- 
achieving countries, the between-countrv differences are consistent with the overall achievement 
effects for these variables. In general, the absolute values of the variables across countries appear to 
be of less importance than their relative values within countries. 

The analvsis does not provide a clearlv defined picture of a set of teaching and learning conditions 
associated with strong student performance. In manv cases, the model shows weak, non- significant 
or negative associations between individual factors and performance in mathematics, once all other 
factors are controlled for. This finding does not mean that teaching and learning factors are irrel- 
evant, or that success is entirelv determined bv other factors such as a student’s background or self- 
confidence: it mav simplv be that the separate effects of teaching and learning factors are difficult to 
measure. Nevertheless, the results do seem to indicate that a combination of conditions is associated 
with effective teaching and learning, not a single factor alone. 

There is one factor that seems to have a universallv strong association with performance when 
adjusting for other factors: disciplinary climate, especiallv at the school level. Students who experi- 
ence disorderlv classrooms are less likelv to perform well, whatever their other characteristics. This 
finding seems to indicate that having an orderlv place to learn is an important prerequisite without 
which teaching and learning cannot thrive. Bevond this condition, factors such as good relations 
with teachers, the adoption of effective learning strategies and homework assignments contribute 
collectivelv to a student’s chances of success, but no individual practice can be said to make a deci- 
sive difference. 

Figure 3.2 illustrates vividly that these and other factors plav a part in explaining differences 
between the performance of different students and schools. At the school level, three-quarters 
of school variance can be attributed to the particular combination of the background factors and 
teaching and learning factors presented in this report. In this context, the analvsis of school differ- 
ences discussed in Chapter 2 is useful. In particular, some countries tend to show relativelv wide 
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differences among schools on a range of variables, and this will have a cumulative effect on students’ 
chances. These differences seem to be particularlv large with respect to school climate and student- 
teacher relations, indicating that it is not just instructional strategies but the learning environment 
that countries need to look at when pursuing equal educational opportunities. 


Moreover, even though there are a few teaching and learning variables with a consistent effect 
across countries, some of those noted above inav be context-specific. For example, while positive 
disciplinary climate seems to be related to higher achievement in all countries, positive student- 
teacher relations have a positive effect on achievement in some countries and a negative effect in 
others. It is not possible, in a broad study such as this, to investigate the specific cultural charac- 
teristics of countries, features of national education svstems or the extent to which interpretations 
of items varv in different languages or cultural contexts. Individual countries mav wish to pursue 
longitudinal studies to delve into issues such as homework time, or observation studies to deepen 
understanding of issues such as classroom climate. 


Final thoughts 

The recent publication of first results from the Teaching and Learning International Survev (TALIS) 
(OECD, 2009) sheds new light on manv of the teaching and learning strategies reported here. 
Using manv of the same constructs as found in PISA, the TALIS studv addresses a major gap in the 
PISA studies bv using a teacher questionnaire to record teaching strategies as well as teacher beliefs 
and attitudes. TALIS categorises teacher beliefs under two main theoretical viewpoints, referred 
to as direct transmission and constructivist. The contrast between these viewpoints is the basis for 
much of the literature on teaching and teacher education. Many of the teaching strategv indices 
used in both PISA and TALIS mav be associated, to a greater or lesser degree, with one or other of 
these positions. 

While TALIS investigates the links between specific teaching strategies and these broader con- 
structs, it does not include measures of student achievement, so cannot address the kev question 
of which of these constructs is most conducive to learning or the circumstances under which one 
or the other mav be more effective. This exercise could be done in future PISA studies, either bv 
including a TALIS-like teacher questionnaire or bv linking existing PISA variables to transmissive 
or constructivist orientations at the school level. The examination of these orientations would be 
a particularlv interesting approach to adopt for PISA 2012, when mathematics will again be the 
main focus of research. Most contemporarv approaches to mathematics curriculum and instruction 
emphasise the importance of problem-solving, which is widely believed to be better taught from a 
constructivist than from a transmissive perspective. 
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Summary of teaching and learning effects and policy implications (coniimied) 
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Summary of teaching and learning effects and policy implications (continued) 
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Unit; percentage of students reporting non-zero time per week 
Unit; standard deviations from the mean 
Unit: interquartile range (25th-75th percentile) 

Unit: number of points change in mathematics score for one standard deviation change in teaching/learning strategy variable 
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OVERVIEW 

Teaching and learning strategies are broad concepts. Teaching strategies refer to a wide range of 
processes, from the wav in which classrooms are organised and resources used to the dailv activities 
engaged in bv teachers and students to facilitate learning. Student learning strategies refer to cogni- 
tive and meta-cognitive processes emploved bv students as they attempt to learn something new. 

PISA 2003 used a varietv of questionnaire items to measure teaching and learning strategies in 
mathematics. These items were combined and scaled to yield a number of composite or index vari- 
ables representing broad constructs. Examples of these constructs are disciplinarv climate, teacher- 
student relations, memorisation strategies and time spent on various learning activities. In PISA 
2003 these measures were specificallv geared towards the learning of mathematics. 

Analvsing the data collected in PISA 2003 can inform policv makers in individual countries as to 
how their situation might differ from that of other countries in terms of consistencv or varietv 
among schools. It can also provide a broad profile of commonalities and differences in mathemat- 
ics teaching and learning within an educational svstem. Merging these variables with the PISA 
assessment of individual competencies, it is also possible to analyse the relationship between stu- 
dent performance and teaching and learning strategies. While limited bv the scope of PISA, its 
cross-sectional nature and the sheer complexitv of the processes involved in teaching and learning 
strategies, these relationships vield important insights for education policy makers and stakeholders. 

The evidence emerging from PISA 2003 shows that svstems differ substantially in the kinds of 
teaching and learning practices most commonlv used across schools. Even within the same edu- 
cational system, there is a large variation in the teaching and learning practices most commonly 
emploved across schools. While PISA shows teaching and learning factors are related to math- 
ematics achievement, the relationships are not consistent and robust across all PISA countries and 
economies. Significant countrv differences stand out for manv of the variables measuring teaching 
and learning strategies. Socio-economic background factors are among the most significant factors 
affecting performance, even after accounting for different teaching and learning strategies. 

Two general messages merge from this evidence. First, the effects of teaching and learning strate- 
gies are best interpreted within countries or clusters of countries with similar cultural backgrounds 
or school svstems. Second, across all countries the use of teaching and learning strategies does not 
seem to signilicantlv mitigate the disadvantaged social backgrounds of some students. 

With respect to findings on specific teaching and learning strategies, the evidence presented in this 
report highlights a number of interesting results. In terms of teaching strategies this studv shows 
the importance of disciplinarv climate and instruction time. The analvsis however does not reveal 
how to achieve a more effective use of either of these strategies, onlv that thev are associated with 
higher performance. 

In terms of student learning strategies, this studv stresses the importance of antecedents over differ- 
ent meta-cognitive strategies. For example, student attitudes such as motivation and confidence are 
stronglv associated with higher performance, while anxietv is associated with lower performance, 
even after accounting for learning strategies and other factors. It is unclear, however, if these stu- 
dent attitudes lead to higher performance or if it is this high performance that leads to, for example. 
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more confidence. For meta-cognitive strategies, while an association between higher performance 
and student use of control and elaboration strategies is observed, it disappears or turns negative 
when other factors are taken into account. The analysis does not reveal however how student learn- 
ing strategies interact with other student factors. 

An important conclusion for education policy makers and analysts emerges from this report. For 
policy makers and stake holders, the value added of the PISA data in this area is highest as a descrip- 
tive tool. The data can best be used to better undenstand which teaching and learning strategies are 
most common and how much variation exists across schools within a particular svstem. Moreover, 
the complexity and the cross country variance apparent in the results suggest that while teaching 
and learning strategies are an important area of educational policy and research, a cross-sectional 
international perspective such as offered bv PISA is of limited use when trying to understand which 
teaching and learning strategies lead to higher student performance and which ones do not, particu- 
larly for complex processes such as individual student meta-cognitive strategies or student-teacher 
relations. 

OVERARCHING ISSUES 

The place of socio-economic status 

Socio-economic background remains one of the strongest predictors of achievement, even in the 
presence of widely varying teaching and learning strategies. Ideally, the impact of socio-economic 
background on achievement would be moderated by the use of appropriate teaching and learning 
strategies, and manv educational policy initiatives are intended to compensate for adverse socio-eco- 
nomic effects. The models used in this study adjust for socio-economic background when examining 
the effects of teaching and learning strategies. Yet, the results show that the teaching and learning 
variables examined here do not seem, in practice, to mitigate verv much the disadvantaged social 
backgrounds of some students. 

Student attitudes, motivations and self-concept 

As with socio-economic status, students’ self-confidence and motivation as learners show consist- 
ent correlations with achievement. Since these variables can be considered to be related to teaching 
and learning strategies as well as to achievement, they are therefore included as antecedents in the 
models. Nevertheless, unlike socio-economic background, the direction of causation is for these 
constructs varies. It is possible that attitudes can be influenced bv teaching strategies and that 
attitudes, themselves, influence learning strategies or are affected bv achievement. Furthermore, 
cultural differences are likelv to affect students’ interpretation of self-confidence and motivation 
questions. Therefore, results in these areas should be interpreted taking into account the context 
and culture of each specific country. 

PISA 2003 measured self-efficacv, specifically in relation to mathematics, using questionnaire 
items in which students were asked to judge their competence at solving a variety of mathematics 
problems, yielding the index of self-efficacv in mathematics. Countries in which students have a 
greater sense of self-efficacv tend to have better overall performance in mathematics, while within 
most countries there is a correlation with performance that remains even when adjusting for other 
factors. The average sense of self-efficacv (set as zero internationally) varies considerably across 


M^them^tics Teaching and Learning Strategies in PISA © OECD 2010 


141 


Copvn0hf«3 


Conclusions ^nd Implications fot Policy ^n4 Pt^ctice 


Conclusions 3n4 Implications foi- Policy 3n4 Pi'^ctice 


1 


countries. In the Slovak Republic students on average have self-efficacv half a standard deviation 
above average, while those in Japan and Korea, and the partner country Thailand, are the same 
amount below average. In countries where students have the least confidence in their own efficacv, 
this variable also makes the least difference to their predicted achievement; the variable is most 
closeiv correlated in some countries with above-average self-efficacv overall. 

Another variable showing wide differences across countries was anxiety in mathematics. Students 
in Japan, Korea and Mexico, and their partner countries Brazil, Thailand and Tunisia (a contrasting 
mix of high- and low-achieving countries), express particularly high levels of anxiety about math- 
ematics. However, in Denmark, Finland, the Netherlands and Sweden (all relatively high-achieving 
countries), students show particularly low anxiety. Both within and across countries, students who 
are anxious about learning mathematics tend to perform worse in the subject. Again, there may be 
lessons here for teachers, especially in countries where anxiety is highest, to make more effort to 
reduce it. Particularly in Mexico and the partner country Brazil, high anxiety tends to go with low 
mathematics performance. 

Instructional time 

For school authorities, the length of the school year and school dav are among the most salient time 
variables. States can also regulate other aspects of time allocation, such as allocations to particular 
subjects or the length of class periods, although these matters are often left to the school. Since 
PISA 2003 did not measure jurisdictional-level variables directly, the available information on global 
time allocations comes from the school questionnaire and hence reflects variations among schools. 

The number of weeks in the school vear varies considerably in countries taking part in PISA, with 
a norm of 36-40 weeks, but only 33 weeks in Ireland, 32 in the partner country Tunisia and 24 
in Mexico. These country differences do have a positive correlation with performance, but within 
countries, the correlation is weak and mostly negative, A second time measure, the length of the 
school week, shows greater variation within some countries than that of the school vear, especially 
in the United States, although in Finland and the partner country Latvia, for example, neither the 
school week nor the school vear vary much. In these countries, the main correlation with per- 
formance is within countries, although when adjusting for other factors the association tends to 
disappear. Similar results apply to the quantity of mathematics teaching, even though here country 
differences are striking: the partner countries Hong Kong-China and Macao-China give over 4.5 
hours of mathematics instruction each week to 1 5 -year-olds, whereas Finland gives only 2.6 hours. 

Yet, across systems there is a strong correlation among total instruction time and mean perform- 
ance in mathematics. Combining the information from the number of hours per week and the 
length of the school vear in weeks per vear, an index of total instruction time is constructed. The 
total instruction time in the vear varies considerably across and within countries. Some of the 
countries with the highest average performance, such as Korea, have also one of the highest vearlv 
instruction times with an estimate of over 1000 hours per vear. Mexico is at the other extreme, 
with an estimate of less than 600 hours of instruction per year on average. Interestingly Korea 
achieves a high total instruction time with over 30 hours per week, the most among OECD coun- 
tries, and less than 36 weeks per year, the OECD average. Mexico has an estimated mean of 24 
hours per week, the OECD average, but at below 24 weeks of instruction per year, it also has one 
of the lowest estimates for the OECD in this measure. 
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STUDENT LEARNING STRATEGIES 

Alternative uses of student learning time outside schools 

PISA measures student use of time bv questions on exposure to tutoring and other out-of-class 
instruction and bv time spent on homework. The proportion of students being tutored in math- 
ematics is in the 10% to 20% range for most countries. It is less than 10% in several high-achieving 
countries such as Belgium, Finland and Japan, but exceeds 30% in some low-achieving countries, 
particularlv Greece, Mexico and Turkev. Patterns of out-of-class lessons are similar. The prevalence 
of tutoring and extra lessons in some low-achieving countries suggests that extra efforts are being 
made bv manv students and bv their parents to overcome low achievement. However, these efforts 
mav not be yielding the expected payoff for indiyiduals or helping to raise the leyel of achieyement 
significant! V for the country as a whole. 

The second major area of student use of time measured in PISA is homework. The PISA .student 
questionnaire contains items on hours per week spent on all homework and on mathematics home- 
work. Similar to tutoring and extra classes, homework tends to be used more in countries with 
lower achieyement oyerall. In the case of homework, the eyidence suggests an oyerall beneficial 
effect within countries. Eyen adjusting for other yariables, total homework time shows significant 
positiye effects on achieyement for almost all countries. Extra mathematics homework appears to 
be targeted to those that need it most as the within country relationship between extra mathematics 
homework and performance tends to be negatiye across systems. The small proportion of students 
reporting no mathematics homework tends to haye higher achieyement than those reporting some 
mathematics homework. 

All of this presents a complex picture for the homework effect. Negatiye country-leyel correlations 
and the inordinate amount of time spent by students in some low-achieying countries on homework 
suggest that extra efforts in terms of mathematics homework used to compensate for limitations of 
schooling or to substitute for instruction by teachers can only haye a limited positiye effect. It also 
seems likely that in many high-achieying countries, and for high-achieying students in all countries, 
the mathematics teaching proyided in school is sufficient to allow students to function well without 
extra homework. It is clear howeyer that within each country, higher-achieying students are doing 
more homework oyerall. 

Meta-cognitive strategies 

Meta-cognitiye strategies are generic approaches that students use in addressing a learning task. The 
three index variables that PISA uses for these strategies are memorisation /rehearsal, elaboration 
strategies and control strategies. Consistent with expectations, memorisation strategies tend to be 
less frequently used than either elaboration or control strategies. They tend to be used more by stu- 
dents in relatively low-performing countries, with students in Mexico, Brazil, Thailand and Tunisia 
saying that they use memorisation the most, producing a very high negative correlation between 
countries’ use of memorisation and their performance in PISA. The within-countrv correlations 
with achievement are mostly close to zero, but with a few significant positive and negative values. 

Students report using elaboration strategies more often than memorisation strategies. In most coun- 
tries, the patterns of relationship are similar. On the standard scale, students in Mexico and Turkev, 
and the partner countries Brazil, Serbia, Thailand and Tunisia, show the highest positive levels 
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of use of this strategy, while those in Japan and Korea show the highest negative levels. Within- 
countrv correlations are mostly small but the between-country correlation is strongly negative. This 
tendency would seem to be confirmed bv students’ self-reports on control strategies, where again 
students in Mexico and the partner countries Brazil and Tunisia, along with those in Austria and the 
partner country Serbia, are the most likely to sav they controlled their learning. Control strategies 
differ from the other two meta- cognitive strategies in that in some countries there is a correlation 
between the adoption of such strategies and performance, even after adjusting for other factors. 
However, this result applies to only one-half of these countries, and the correlation is negative as 
often as positive. 

Co-operative and competitive learning situations 

In this report indices of co-operative learning and of competitive learning strategies derive from 
student responses to PISA items asking whether students prefer working with others or helping 
others or whether thev want to be the best or do better than others. Overall, a majority of students 
in most countries tend to agree with statements reflecting both of the.se strategies, suggesting that 
these strategies may not be opposites on a single continuum. Indeed, these indices correlate posi- 
tively with each other in most countries. Students in Japan showed much less enthusiasm for either 
strategy than elsewhere in the OECD, while students in the partner countries Brazil and Tunisia 
were strongly positive on both. Students who engage in competitive learning tend to be among the 
higher achievers in many countries, but this effect disappears once other characteristics of these 
students have been taken into account. Co-operative learning does not correlate with achievement 
at either level. 

TEACHING STRATEGIES 
Disciplinary climate 

Across the group of countries studied, disciplinary climate is the teaching and learning factor that 
has the strongest correlation with performance. This correlation remains positive and significant 
in most countries even after adjusting for other factors. Japan and the Russian Federation have the 
most positive disciplinary climate, and Brazil the most negative. Overall the average scores on this 
variable do not differ greatly across countries. 

In contrast, within-countrv differences in disciplinary climate are a key issue. One of the most 
important findings of this study is that disciplinary climate is not onlv the teaching and learning 
factor with the closest link to performance, but also the one in which differences across schools 
are particularly high. (Although reported by students individually, this factor was aggregated to 
the school level.) Moreover, the correlation between disciplinary climate and achievement is much 
higher at the school than at the student level. These results show that if school systems are to pro- 
vide equal learning opportunities to all of their students, it is very important to improve the disci- 
plinary climate in those schools where it is poor. 

Teacher support and student-teacher relations 

The index of student -teacher relations comprises items that closely resemble those for teacher sup- 
port, dealing with the extent to which students get along with teachers, whether teachers listen 
to students and whether teachers treat students fairly. A majority of students in most countries are 
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of the view that their teachers support them. However, there is more variation across countries 
in this factor than in disciplinarv climate. The highest average levels of teacher support arise in 
Mexico and Turkev, and the partner countries Brazil and Thailand, while the lowest levels occur 
in Austria, Germanv, Japan and Luxembourg. Teacher support correlates mainlv negatively with 
achievement within countries and most of the model effects are negative, suggesting that support 
intentionallv concentrates on weaker students. Several western European countries show positive 
effects for student-teacher relations while several eastern European countries, along with Mexico 
and the partner countries Thailand and Tunisia, show negative effects. One possible explanation for 
these findings is that in some countries teachers focus on those students who need it most, provid- 
ing more support to low performing students. 


CONCLUSION 

This Studv shows that there are wide variations across countries in the average values of the PISA 
variables measuring teaching and learning strategies and in the level of diversitv among schools in 
values of these variables within countries. There is some evidence of clustering of countries with 
similar cultural features or with similar school svstems. For example, a few countries show con- 
sistent patterns of high diversitv across schools, suggesting a highlv decentralised school svstem. 
However, these clusters do not seem to be clearlv linked to mathematics achievement. In some 
cases, the patterns indicate unusual teaching and learning patterns, such as the relativelv high 
homework levels in some low-achieving countries, which appear to conflict with the overall results 
for these variables. In other cases, such as the high level of memorisation in some low-achieving 
countries, the between-countrv differences are consistent with the overall achievement effects for 
these variables. In general, the absolute values of the variables across countries appear to be of less 
importance than their relative values within countries. 
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Table A.l 

Instructional weeks per year: mean, standard deviation and percentile distribution among schools 




Schools at the . , . 




Standard 

5th 

25th 

50th 

75th 

95th 


Mean 

deviation 

percentile 

percentile 

percentile 

percentile 

percentile 


Mean 

S.E. 

S.D. 

S.E. 

pS 

S.E. 

p25 

S.E. 

p50 

S.E. 

p75 

S.E. 

p95 

S.E. 

OECD 















Australia 

39,4 

(0.1) 

1.8 

(0.1) 

36,0 

(0.0) 

39.0 

(O.S) 

40.0 

(0.0) 

40.0 

(0.0) 

41.0 

(0.3) 

Austria 

36.7 

(0.8) 

9.2 

(1.0) 

10.0 

(0.0) 

38.0 

(0.5) 

40.0 

(0.4) 

40.0 

(0.4) 

43.0 

(0.0) 

Belgium 

36.2 

(0.2) 

3.2 

(0.2) 

30.0 

(0.3) 

36.0 

(0.4) 

38.0 

(0.9) 

38.0 

(0.9) 

40.0 

(0.0) 

Canada 

38.6 

(0.2) 

3.0 

(0.3) 

35.0 

(1.3) 

38.0 

(1.0) 

40.0 

(0.0) 

40.0 

(0.0) 

41.0 

(0.7) 

Czech Republic 

41.0 

(0.2) 

2.2 

(0.2) 

37.0 

(0.9) 

40.0 

(0.0) 

43.0 

(0.0) 

43.0 

(0.0) 

44.0 

(0.0) 

Denmark. 

39.6 

(0.1) 

1.5 

(0.3) 

36.0 

(1.3) 

40.0 

(0.0) 

40.0 

(0.0) 

40.0 

(0.0) 

40.0 

(0.0) 

Finland 

38.1 

(0.0) 

0.5 

(0.1) 

38,0 

(0.0) 

38.0 

(0.0) 

38.0 

(0.0) 

38.0 

(0.0) 

39.0 

(0.9) 

France 

m 

m 

m 

m 

m 

m 

m 

m 

m 

m 

m 

m 

m 

m 

Germany 

39.7 

(0.2) 

2.4 

(0,2) 

36.0 

(0,5) 

38.0 

(0.0) 

42.0 

(1.3) 

42.0 

(1.3) 

43,0 

(1.5) 

Greece 

34.3 

(0.2) 

1,9 

(0.3) 

30.0 

(0,8) 

35.0 

(0.0) 

35.0 

(0.0) 

35.0 

(0.0) 

35.0 

(0,0) 

Hungary 

36.6 

(0.1) 

1.1 

(0.2) 

35.0 

(1.3) 

36,0 

(0.0) 

37,0 

(0.0) 

37,0 

(0.0) 

37.0 

(0.7) 

Iceland 

36.7 

(0.0) 

1.0 

(0.0) 

35.0 

(0.0) 

36.0 

(0.0) 

37.0 

(0.0) 

37.0 

(0.0) 

38.0 

(0.0) 

Ireland 

33.1 

(0.2) 

1.9 

(0.3) 

30.0 

(0.8) 

33.0 

(0.0) 

34.0 

(0.0) 

34.0 

(0.0) 

36.0 

(1.1) 

Italy 

33. S 

(0.2) 

1.8 

(0.2) 

30.0 

(2.7) 

33.0 

(0.0) 

34.0 

(0.0) 

34.0 

(0.0) 

37.0 

(1.6) 

Japan 

38.9 

(0.3) 

4.4 

(0.2) 

32.0 

(2.8) 

35.0 

(0.0) 

43.0 

(1.0) 

43.0 

(1.0) 

45.0 

(0.0) 

Korea 

35.6 

(0.3) 

3.1 

(0.5) 

32.0 

(1.8) 

34.0 

(0.0) 

37.0 

(0.0) 

37.0 

(0.0) 

41.0 

(0.9) 

Luxembourg 

36.0 

(0.0) 

0.0 

(0.0) 

36.0 

(0.0) 

36.0 

(0.0) 

36.0 

(0.0) 

36.0 

(0.0) 

36.0 

(0.0) 

Mexico 

23.9 

(0.7) 

8,0 

(0,6) 

17.0 

(1,1) 

20.0 

(1.3) 

23,0 

(1.6) 

23,0 

(1,6) 

42.0 

(1,8) 

Netherlands 

38.1 

(0.2) 

2.1 

(0.1) 

34.0 

(1.5) 

36,0 

(0.0) 

40.0 

(0.0) 

40.0 

(0.0) 

40.0 

(0.0) 

New Zealand 

36.0 

(0.1) 

2,0 

(0.1) 

33,0 

(0.5) 

35,0 

(0.2) 

38.0 

(1.4) 

38.0 

(1.4) 

40.0 

(0,0) 

Norway 

38.0 

(0.0) 

0.0 

(0.0) 

38.0 

(0.0) 

38.0 

(0.0) 

38.0 

(0.0) 

38.0 

(0.0) 

38.0 

(0.0) 

Poland 

38.3 

(0.2) 

2.2 

(0.2) 

36.0 

(0.7) 

37.0 

(0.0) 

40.0 

(O.S) 

40.0 

(0.5) 

42.0 

(0.0) 

Portugal 

35.4 

(0.2) 

2.5 

(0.4) 

32.0 

(0.6) 

35.0 

(0.8) 

36.0 

(0.0) 

36.0 

(0.0) 

40.0 

(2.3) 

Slovak Republic 

39.2 

(0.3) 

4.0 

(0.2) 

33.0 

(0.0) 

36.0 

(1.8) 

43.0 

(0.0) 

43.0 

(0.0) 

44.0 

(0.0) 

Spain 

35.4 

(0.2) 

2.2 

(0.2) 

32.0 

(0.0) 

35.0 

(1.0) 

36.0 

(1.7) 

36.0 

(1.7) 

39.0 

(1.4) 

Sweden 

36.6 

(0.1) 

1.7 

(0.2) 

34.0 

(0.9) 

36.0 

(0.0) 

37.0 

(1.0) 

37.0 

(1.0) 

40.0 

(0.0) 

Switzerland 

39.2 

(0.1) 

1.3 

(0.2) 

37.0 

(0.0) 

39.0 

(0.0) 

40.0 

(0.0) 

40.0 

(0.0) 

40.0 

(0.0) 

Turkey 

35,7 

(0.3) 

3.5 

(0,6) 

28.0 

(5.8) 

36,0 

(0.4) 

37.0 

(0.0) 

37.0 

(0,0) 

39.0 

(1,3) 

United States 

36,0 

(0.0) 

0.7 

(0.1) 

35,0 

(0.0) 

36.0 

(0.0) 

36.0 

(0,0) 

36.0 

(0.0) 

37.0 

(0.0) 

OECD average 

36.7 

(0.0) 

2.4 

(0.1) 

32.5 

(0.3) 

35.9 

(0.1) 

37.8 

(0.1) 

37.8 

(0.1) 

39.9 

(0.2) 

Partners 















Brazil 

40.6 

(0.2) 

2.1 

(0.3) 

39.0 

(1.4) 

40.0 

(0.0) 

41.0 

(0.8) 

41,0 

(0.8) 

45.0 

(0.4) 

Hong Kong- China 

35.4 

(0.4) 

4.9 

(0.2) 

28.0 

(1,0) 

31.0 

(1.3) 

40.0 

(0.0) 

40.0 

(0.0) 

42.0 

(0.2) 

Indonesia 

40.0 

(0.4) 

5,0 

(0.4) 

33.0 

(1.4) 

37.0 

(1.0) 

43,0 

(0.9) 

43,0 

(0.9) 

48,0 

(0.8) 

Latvia 

34.9 

(0.1) 

0.8 

(0.1) 

34,0 

(0.9) 

35.0 

(0.0) 

35.0 

(0.0) 

35.0 

(0,0) 

36.0 

(0.2) 

Liechtenstein 

39.0 

(0.0) 

0.8 

(0.0) 

38.0 

(0.0) 

38,0 

(0.0) 

40.0 

(0.0) 

40.0 

(0.0) 

40,0 

(0,0) 

Macao-China 

39.2 

(0.0) 

2.8 

(0.0) 

36.0 

(2.0) 

38.0 

(0.0) 

41.0 

(0.0) 

41.0 

(0.0) 

42.0 

(0.0) 

Russian Fed. 

35.0 

(0.2) 

2.2 

(0.2) 

33.0 

(1.3) 

34.0 

(0.0) 

35,0 

(1.3) 

35.0 

(1.3) 

40.0 

(0.0) 

Serbia 

37.1 

(0.1) 

1.3 

(0.3) 

35.0 

(0.0) 

37.0 

(0.0) 

37.0 

(0.0) 

37.0 

(0.0) 

39.0 

(0.0) 

Thailand 

39.7 

(0.1) 

1.1 

(0.1) 

36.0 

(0.0) 

40.0 

(0.0) 

40.0 

(0.0) 

40.0 

(0.0) 

40.0 

(0.0) 

Tunisia 

31.9 

(0.3) 

3.6 

(0.3) 

26.0 

(1.1) 

30.0 

(0.0) 

33.0 

(1.2) 

33.0 

(1.2) 

38.0 

(1.0) 

Uruguay 

33.9 

(0.2) 

2.5 

(0.1) 

30.0 

(0.0) 

32.0 

(0.0) 

36.0 

(0.0) 

36.0 

(0.0) 

37.0 

(0.0) 

United Kingdom 

37.8 

(0.1) 

1.4 

(0.2) 

35.0 

(0.4) 

38.0 

(0.0) 

38.0 

(0.0) 

38.0 

(0.0) 

39.0 

(0.0) 


1. Response rate too low to ensure comparabilitv. 
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Table A. 2 

Instructional hours in school week: mean, standard deviation and percentile distribution among schools 




Schools at the . , . 




Standard 

5th 

25th 

50th 

75th 

95th 


Mean 

deviation 

percentile 

percentile 

percentile 

percentile 

percentile 


Mean 

S.E. 

S.D. 

S.E. 

pS 

S.E. 

p25 

S.E. 

p50 

S.E. 

p75 

S.E. 

p9S 

S.E. 

OECD 















Australia 

24.1 

(0,1) 

5,6 

(0.1) 

14.0 

(0.4) 

23,0 

(0.3) 

26.3 

(0.3) 

26.3 

(0.3) 

31.0 

(1.0) 

Austria 

27,2 

(0.3) 

7.6 

(0.3) 

7.5 

(1,1) 

25.0 

(0.8) 

31.7 

(0.2) 

31.7 

(0.2) 

37.5 

(1.3) 

Belgium 

26.9 

(0.1) 

4.4 

(0.1) 

18.5 

(1.4) 

26.7 

(0.0) 

29.2 

(1.0) 

29.2 

(1.0) 

30.0 

(0.0) 

Canada 

23.6 

(0.1) 

7.4 

(0.1) 

5.4 

(0.3) 

23.3 

(0.3) 

25.7 

(0.1) 

25.7 

(0.1) 

32.1 

(0.7) 

Czech Republic 

23.6 

(0.1) 

1.8 

(0.1) 

20.8 

(0.7) 

22.5 

(0.0) 

24.8 

(0.0) 

24.8 

(0.0) 

27.0 

(O.S) 

Denmark 

22.1 

(0.2) 

5.1 

(0.4) 

15.0 

(0.0) 

21.0 

(0.0) 

23.3 

(0.0) 

23.3 

(0.0) 

29.3 

(1.0) 

Finland 

22.6 

(0.1) 

2.0 

(0.1) 

20.3 

(0,2) 

22.5 

(0.0) 

23.3 

(0.0) 

23.3 

(0.0) 

25.5 

(0.2) 

France 

24.8 

(0.2) 

7,0 

(0.1) 

9.2 

(0.8) 

22.9 

(0.8) 

29,0 

(0.7) 

29,0 

(0.7) 

33.0 

(0.4) 

Germany 

22.6 

(0.1) 

3,7 

(0.2) 

17.3 

(1.0) 

21,8 

(0.0) 

24.0 

(0.0) 

24,0 

(0.0) 

27.0 

(0.0) 

Greece 

23.5 

(0.1) 

1.4 

(0.0) 

22.5 

(0.0) 

22.5 

(0.0) 

25,5 

(0.0) 

25,5 

(0.0) 

26.3 

(0.0) 

Hungary 

23.9 

(0.1) 

2,9 

(0.1) 

20.8 

(0.6) 

22.5 

(0.0) 

24.9 

(0.8) 

24.9 

(0.8) 

27.8 

(0.8) 

Iceland 

26.1 

(0.1) 

6.9 

(0.1) 

20.0 

(0.7) 

24.0 

(0.0) 

26,0 

(0.2) 

26.0 

(0.2) 

48.0 

(1.1) 

Ireland 

27.4 

(0.1) 

4.8 

(0.2) 

18.7 

(1.4) 

26.7 

(0.1) 

30.0 

(0.0) 

30.0 

(0.0) 

30.0 

(0.6) 

Italy 

26,4 

(0.3) 

7.6 

(0.2) 

9.0 

(1.0) 

24.8 

(0.4) 

30.0 

(0.7) 

30.0 

(0.7) 

35.0 

(0.4) 

Japan 

23.8 

(0.2) 

6.7 

(0.2) 

7.5 

(0.6) 

24.0 

(0.7) 

27.1 

(O.S) 

27.1 

(O.S) 

31.7 

(0.8) 

Korea 

30.2 

(0.3) 

8.3 

(0.3) 

7.5 

(1.2) 

29.2 

(0.0) 

34.2 

(1.1) 

34.2 

(1.1) 

40.8 

(1.2) 

Luxembourg 

24.1 

(0.1) 

4.8 

(0.1) 

10.8 

(1.6) 

25.0 

(0.0) 

25.8 

(0.2) 

25.8 

(0.2) 

26.7 

(0.3) 

Mexico 

24,0 

(0.3) 

9.8 

(0.1) 

6.0 

(0,2) 

17.5 

(1.2) 

30.0 

(0.0) 

30.0 

(0.0) 

37.5 

(0.3) 

Netherlands 

23.9 

(0.2) 

4,9 

(0.2) 

13.3 

(1,2) 

22,5 

(0.0) 

26.7 

(0.0) 

26,7 

(0.0) 

29,2 

(0.0) 

New Zealand 

23.5 

(0.1) 

5,5 

(0.2) 

9.0 

(1,3) 

22,9 

(0.0) 

25,0 

(0.0) 

25,0 

(0.0) 

30,0 

(0.8) 

Norway 

22,1 

(0.1) 

4.0 

(0.1) 

15.0 

(0.8) 

22.5 

(0.1) 

22.5 

(0.0) 

22.5 

(0.0) 

27.0 

(0.1) 

Poland 

22.9 

(0.1) 

3.4 

(0.1) 

18.8 

(0.0) 

22.5 

(0.3) 

24.0 

(0.0) 

24.0 

(0.0) 

27.0 

(0.2) 

Portugal 

25,1 

(0.3) 

8.0 

(0.4) 

12.8 

(0.7) 

22.5 

(0.2) 

26.7 

(0.6) 

26.7 

(0.6) 

45.0 

(1.4) 

Sloyak Republic 

23,5 

(0.1) 

3.7 

(0.2) 

18.0 

(0.7) 

22.5 

(0.3) 

24.9 

(0.8) 

24.9 

(0.8) 

27.8 

(0.6) 

Spain 

26.4 

(0.1) 

4.9 

(0.2) 

15.0 

(1.6) 

25.0 

(0.0) 

29.3 

(0.2) 

29.3 

(0.2) 

31.5 

(0.8) 

Sweden 

22.5 

(0.2) 

5.4 

(0.2) 

13.3 

(0.3) 

20.0 

(0.0) 

25.0 

(0.0) 

25.0 

(0.0) 

30.0 

(1.4) 

Switzerland 

24.1 

(0.3) 

4.9 

(0.5) 

13.3 

(3.5) 

23.5 

(0.7) 

26.7 

(O.S) 

26.7 

(O.S) 

29.3 

(0.1) 

Turkey 

23.1 

(0.3) 

6,2 

(0.5) 

8.7 

(0.7) 

21.3 

(0.0) 

26,7 

(1.0) 

26.7 

(1.0) 

30,0 

(0.0) 

United States 

22,1 

(0.3) 

11,3 

(0.2) 

5.3 

(0.2) 

9,6 

(1.4) 

30.0 

(0.0) 

30.0 

(0.0) 

35.8 

(1.6) 

OECD average 

24.4 

(0.0) 

5.5 

(0.0) 

13.7 

(0.2) 

22.8 

(O.I) 

26.8 

(O.I) 

26.8 

(0.1) 

31.6 

(0.1) 

Partners 















Brazil 

19.0 

(0.2) 

6.1 

(0.2) 

6.7 

(0.1) 

16.7 

(0.0) 

20.9 

(0.6) 

20.9 

(0.6) 

26.5 

(0.8) 

Hong Kong- China 

26.5 

(0.2) 

6.8 

(0.2) 

7.5 

(0.7) 

23.3 

(0.3) 

31.5 

(0.7) 

31.5 

(0.7) 

35.0 

(0.8) 

Indonesia 

m 

m 

m 

m 

m 

m 

m 

m 

m 

m 

m 

m 

m 

m 

Latvia 

23.9 

(0.2) 

4.1 

(0.6) 

20.0 

(0.0) 

23,3 

(0.3) 

24.7 

(0.0) 

24.7 

(0.0) 

28.0 

(0.4) 

Liechtenstein 

27.1 

(0.2) 

3.2 

(0.4) 

24.0 

(0.6) 

26.3 

(0.0) 

28.5 

(0.0) 

28.5 

(0.0) 

30.8 

(0.2) 

Macao-China 

26.9 

(0.1) 

4.9 

(0.3) 

20.7 

(2.0) 

26.0 

(0.2) 

29.3 

(0.0) 

29,3 

(0.0) 

32.0 

(1.1) 

Russian Fed. 

23.8 

(0.2) 

5.2 

(0.4) 

17.3 

(1.1) 

21.3 

(0.0) 

26.2 

(0.8) 

26.2 

(0.8) 

30.0 

(0.4) 

Serbia 

23.7 

(0.1) 

4.6 

(0.2) 

16.5 

(1.9) 

22.5 

(0.0) 

25.5 

(0.0) 

25.5 

(0.0) 

28.5 

(O.S) 

Thailand 

30.5 

(0.2) 

3.7 

(0.2) 

25.0 

(1.2) 

29.2 

(0.0) 

33.3 

(0.6) 

33.3 

(0.6) 

36.7 

(O.S) 

Tunisia 

27.6 

(0.2) 

6.5 

(0.2) 

13.0 

(2.7) 

26.0 

(0.0) 

30.0 

(O.S) 

30.0 

(0.5) 

36.0 

(1.4) 

Uruguay 

21.6 

(0.3) 

6.5 

(0.2) 

9.0 

(0.7) 

18,7 

(0.7) 

26.0 

(0.9) 

26.0 

(0.9) 

30.8 

(1.4) 

United Kingdom 

24.6 

(0.1) 

5.1 

(0.2) 

17.0 

(1.8) 

25.0 

(0.3) 

25.0 

(0.0) 

25.0 

(0.0) 

30.0 

(0.0) 


1. Response rate too low to ensure comparabilitv. 
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Annex A; Pescn'ptive Statistics 



Table A. 3 

Index of total instructional hours per year: mean, standard deviation and percentile distribution among schools 







Schools 

at the . , 








Standard 

Sth 

25th 

50th 

75th 

95th 


Mean 

deviation 

percentile 

percentile 

percentile 

percentile 

percentile 


Mean 

S.E. 

S.D. 

S.E. 

p5 

S.E. 

p25 

S.E. 

p50 

S.E. 

p75 

S.E. 

p95 

S.E. 

OECD 















Australia 

952. 5 

(5,4) 

226.2 

(6.0) 

546.0 

(24.2) 

900,0 

(0.0) 

1025,0 

(15,6) 

1025.0 

(15.6) 

1240,0 

(34.1) 

Austria 

991.4 

(18.7) 

353.6 

(14.9) 

285,0 

(23,2) 

900.0 

(35.2) 

1233.3 

(16.3) 

1233.3 

(16.3) 

1397.5 

(32.5) 

Belgium 

968.6 

(6.4) 

179,8 

(5.6) 

671,7 

(15.5) 

925.0 

(26.0) 

1066.7 

(6.5) 

1066.7 

(6.5) 

1171.7 

(25.7) 

Canada 

909.7 

(5.3) 

295.9 

(4.7) 

215.0 

(8.4) 

871.2 

(7.9) 

1023.8 

(9.9) 

1023.8 

(9.9) 

1260.0 

(21.7) 

Czech Republic 

930.1 

(5.5) 

77.0 

(3.9) 

780.0 

(21.6) 

900.0 

(3.3) 

967,5 

(8.6) 

967.5 

(8.6) 

1050.0 

(7.5) 

Denmark 

857.6 

(6.1) 

163.7 

(13.0) 

600.0 

(4.3) 

840.0 

(14.1) 

900.0 

(18.9) 

900.0 

(18.9) 

1050.0 

(32.5) 

Finland 

860.5 

(2.5) 

77.9 

(3.9) 

769.5 

(6.3) 

855.0 

(0.0) 

883.5 

(0.0) 

883.5 

(0.0) 

969.0 

(13.1) 

France 

m 

m 

m 

m 

m 

m 

m 

m 

m 

m 

m 

m 

m 

m 

Germany 

901,5 

(5.6) 

144,6 

(7.2) 

684.0 

(25.3) 

848.3 

(12.4) 

966.6 

(10.4) 

966.6 

(10.4) 

1102.5 

(19.8) 

Greece 

805.6 

(5.1) 

64.0 

(5.0) 

697.5 

(33.5) 

787,5 

(0.0) 

813,8 

(46.2) 

813,8 

(46.2) 

918,8 

(0.0) 

Hungary 

876,8 

(3.9) 

106.5 

(5.0) 

749,3 

(8.2) 

832.5 

(0,0) 

915.8 

(6.2) 

915.8 

(6,2) 

1026.0 

(27,4) 

Iceland 

953.4 

(3.0) 

249,8 

(3.3) 

760.0 

(17.6) 

864.0 

(0.8) 

937.3 

(0.0) 

937.3 

(0,0) 

1728.0 

(39.2) 

Ireland 

903,3 

(6.7) 

166,6 

(5.7) 

612.0 

(30.3) 

866.3 

(12.3) 

990,0 

(2.1) 

990,0 

(2,1) 

1050.0 

(20.6) 

Italy 

884,0 

(9.8) 

256.9 

(7.7) 

300.0 

(26.3) 

820.4 

(9.8) 

1023,0 

(9.3) 

1023.0 

(9.3) 

1188.0 

(5.4) 

Japan 

931.1 

(12.5) 

285.7 

(8.5) 

273.3 

(23.2) 

845.8 

(17.9) 

1105.7 

(12.3) 

1105.7 

(12.3) 

1300.0 

(36.3) 

Korea 

1073.9 

(15.1) 

312.3 

(12.7) 

255.0 

(13.2) 

991.7 

(21.8) 

1225.0 

(17.7) 

1 225.0 

(17.7) 

1541.7 

(46.4) 

Luxembourg 

865.9 

(2.9) 

176.4 

(4.9) 

390.0 

(49.2) 

900.0 

(0.0) 

930.0 

(20.6) 

930.0 

(20.6) 

972.0 

(25.0) 

Mexico 

564,3 

(17.1) 

305.9 

(18.2) 

128.3 

(6,5) 

375.0 

(18,8) 

666.7 

(28.6) 

666.7 

(28.6) 

1200.0 

(33.9) 

Netherlands 

911,4 

(7.8) 

194,5 

(7.9) 

506,7 

(39.9) 

840.0 

(11.5) 

1020.0 

(11.4) 

1020.0 

(11,4) 

1133.3 

(4.2) 

New Zealand 

845 .4 

(4.8) 

197,5 

(6.1) 

348.3 

(48.8) 

816.7 

(3.9) 

924.0 

(15.9) 

924.0 

(15.9) 

1023,2 

(23.6) 

Norway 

840.3 

(4.4) 

151.7 

(5.1) 

570.0 

(31.1) 

855.0 

(2.5) 

855.0 

(0.0) 

855.0 

(0.0) 

1026.0 

(2.8) 

Poland 

876.9 

(5.3) 

140,8 

(4.9) 

702.0 

(10.8) 

832.5 

(7.2) 

936.0 

(10.1) 

936,0 

(10.1) 

1054.5 

(19.5) 

Portugal 

881.9 

(12.9) 

287.7 

(14.0) 

437.5 

(11.7) 

765.0 

(13.8) 

935,0 

(15.5) 

935.0 

(15.5) 

1522.5 

(93.5) 

Slovak Republic 

917.0 

(7.3) 

165.5 

(7.9) 

693.0 

(12.2) 

826.5 

(18.2) 

999.8 

(20.5) 

999.8 

(20.5) 

1161.0 

(15.8) 

Spain 

937.4 

(7.6) 

182.9 

(6.9) 

551.3 

(34.5) 

886.5 

(15.8) 

1045.0 

(7.3) 

1045.0 

(7.3) 

1140.0 

(7.7) 

Sweden 

822.5 

(8.9) 

200.4 

(7.6) 

490.0 

(21.6) 

720.0 

(3.9) 

910.0 

(12.2) 

910.0 

(12.2) 

1166.7 

(68.8) 

Switzerland 

951.9 

(7.0) 

176.3 

(7.9) 

540.0 

(19.1) 

912.0 

(2.7) 

1050.0 

(3.1) 

1050.0 

(3.1) 

1140.8 

(28.8) 

Turkey 

812.5 

(15.7) 

238.9 

(19.7) 

317.3 

(6.6) 

746.7 

(22.6) 

933,3 

(25.1) 

933,3 

(25.1) 

1080,0 

(35.2) 

United States 

803.9 

(11.4) 

403.4 

(6.1) 

194,0 

(4.2) 

378.0 

(59,8) 

1080.0 

(19.4) 

1080.0 

(19.4) 

1282.5 

(49.0) 

OECD average 

888.3 

(1.7) 

206.0 

(1.7) 

507. i 

(4.7) 

821.4 

(3.3) 

976.3 

(3.0) 

976,3 

(3.0) 

U72.5 

(6.2) 

Partners 















Brazil 

769.1 

(9.1) 

251.6 

(7.5) 

260.0 

(13.2) 

666.7 

(4.3) 

891.8 

(19.9) 

891.8 

(19.9) 

1102.5 

(37.7) 

Hong Kong- China 

936.2 

(13.4) 

277.8 

(8.1) 

266.7 

(21.7) 

798.0 

(19.3) 

1114.8 

(14.0) 

1114.8 

(14.0) 

1306.7 

(10.6) 

Indonesia 

m 

m 

m 

m 

m 

m 

m 

m 

m 

m 

m 

m 

m 

m 

Latvia 

824.9 

(4.4) 

114,8 

(4.8) 

700.0 

(0.0) 

793,3 

(14,0) 

863.3 

(2.6) 

863.3 

(2.6) 

956.7 

(27.8) 

Liechtenstein 

1059,5 

(6.2) 

118,4 

(16.1) 

940,5 

(26.1) 

997.5 

(0.0) 

1140.0 

(9.8) 

1140.0 

(9.8) 

1230,0 

(11.2) 

Macao-China 

1055,4 

(5.8) 

204,4 

(9.7) 

738,0 

(34.2) 

1014.0 

(14.5) 

1148.0 

(6.2) 

1148.0 

(6.2) 

1260,0 

(19.8) 

Russian Fed. 

835.0 

(12.5) 

208.4 

(26.4) 

612.0 

(26.4) 

725,3 

(18.9) 

899,9 

(23.9) 

899.9 

(23.9) 

1080.0 

(29.4) 

Serbia 

883.9 

(5.5) 

162.0 

(7.2) 

682.5 

(29.8) 

832.5 

(0.0) 

943,5 

(11.2) 

943,5 

(11.2) 

1069.5 

(19.7) 

Thailand 

1210.1 

(7.4) 

152.3 

(7.5) 

936.0 

(53.5) 

1166.7 

(0.0) 

1300.6 

(32.5) 

1300.6 

(32.5) 

1466.7 

(27.6) 

Tunisia 

835.4 

(12.0) 

225.4 

(11.5) 

304.0 

(71.1) 

756.0 

(16.6) 

928.0 

(16.9) 

928.0 

(16.9) 

1120.0 

(32.3) 

Uruguay 

727.8 

(12.9) 

232.6 

(8.1) 

288.8 

(22.4) 

600.0 

(11.2) 

864.0 

(16.5) 

864.0 

(16.5) 

1071.0 

(28.2) 

United Kingdom 

930.6 

(4.3) 

190.3 

(7.0) 

646.0 

(51.6) 

918.3 

(15.1) 

950.0 

(0.0) 

950.0 

(0.0) 

1108.3 

(20.8) 


1. Response rate too low to ensure comparability. 
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Table A. 4 

Hours per week of mathematics instruction: mean, standard deviation and percentile distribution among schools 




Schools at the . . , 




Standard 


5th 

25th 

50th 

75th 

95th 


Mean 

deviation 

percentile 

percentile 

percentile 

percentile 

percentile 


Mean 

S.E. 

S.D. 

S.E. 

p5 

S.E. 

p2 5 

S.E. 

p50 

S.E. 

p7S 

S.E. 

p9S 

S.E. 

OECD 















Australia 

3.8 

(0.0) 

1.4 

(0.1) 

2.3 

(0.0) 

3.3 

(0,0) 

4.2 

(0.1) 

4.2 

(0.1) 

6.0 

(0.2) 

Austria 

2.8 

(0.1) 

1.6 

(0.1) 

0.8 

(0.0) 

1,7 

(0.1) 

3.3 

(0,0) 

3.3 

(0.0) 

5.0 

(0.4) 

Belgium 

3,3 

(0.0) 

1.4 

(0.1) 

0.8 

(0,0) 

2.5 

(0,0) 

4.2 

(0.0) 

4.2 

(0.0) 

5.0 

(0,1) 

Canada 

3,7 

(0.0) 

2.7 

(0.0) 

0.0 

(0.0) 

1.3 

(0.1) 

5.8 

(0,2) 

5,8 

(0.2) 

6,7 

(0.1) 

Czech Republic 

2.8 

(0,0) 

0.8 

(0.0) 

1,5 

(0.0) 

2.3 

(0.0) 

3,0 

(0.0) 

3,0 

(0,0) 

3,8 

(0.4) 

Denmark 

3.4 

(0,0) 

1,3 

(0.1) 

2.3 

(0.0) 

3.0 

(0.0) 

3.8 

(0.0) 

3.8 

(0.0) 

5,3 

(0.1) 

Finland 

2.6 

(0.0) 

1.2 

(0.1) 

0.0 

(0.0) 

2.3 

(0.0) 

3.0 

(0.4) 

3.0 

(0.4) 

4.5 

(0.0) 

France 

3.5 

(0.0) 

1.3 

(0.1) 

1.5 

(0.7) 

2.8 

(0.0) 

3.7 

(0.0) 

3.7 

(0.0) 

4.6 

(0.0) 

Germany 

3.0 

(0.0) 

1.4 

(0.1) 

1.5 

(0.4) 

2.3 

(0.0) 

3.0 

(0.0) 

3.0 

(0.0) 

4.5 

(0.0) 

Greece 

3.1 

(0.0) 

0.7 

(0.0) 

2.3 

(0.0) 

3.0 

(0.0) 

3.8 

(0.0) 

3.8 

(0.0) 

3.8 

(0.0) 

Hungary 

2.7 

(0.0) 

0.8 

(0.1) 

2.3 

(0.0) 

2.3 

(0.0) 

3.0 

(0.0) 

3.0 

(0.0) 

3.8 

(0.0) 

Iceland 

4.2 

(0.0) 

1.4 

(0.1) 

3.3 

(0.0) 

3.3 

(0.0) 

4.2 

(0.2) 

4.2 

(0.2) 

7.7 

(0.6) 

Ireland 

3.2 

(0,0) 

1,2 

(0.1) 

2.0 

(0.0) 

2.9 

(0.2) 

3,3 

(0.0) 

3,3 

(0,0) 

4,0 

(0.0) 

Italy 

3,5 

(0.1) 

1,6 

(0.1) 

0.9 

(0.1) 

2.8 

(0.1) 

4.2 

(0,0) 

4.2 

(0.0) 

5,3 

(0.3) 

japan 

3.6 

(0.1) 

1.7 

(0.1) 

0.9 

(0.8) 

2.5 

(0.0) 

4.3 

(0.3) 

4,3 

(0,3) 

5.8 

(0.0) 

Korea 

4.1 

(0.1) 

1,8 

(0.1) 

2.5 

(0.0) 

3.3 

(0.0) 

4.2 

(0.1) 

4.2 

(0.1) 

6,7 

(0.6) 

Luxembourg 

3.3 

(0.0) 

1,5 

(0.1) 

1.7 

(0.0) 

3.3 

(0.0) 

3,3 

(0.0) 

3,3 

(0.0) 

5,0 

(0.0) 

Mexico 

4.0 

(0.1) 

2.6 

(0.2) 

I.l 

(0.3) 

3.0 

(0,3) 

4.2 

(0.0) 

4.2 

(0.0) 

7.5 

(0,5) 

Netherlands 

2.5 

(0.0) 

1.5 

(0.1) 

0.0 

(0.0) 

2.3 

(0.2) 

3.0 

(0.3) 

3.0 

(0.3) 

3.8 

(0.2) 

New Zealand 

4.0 

(0.0) 

1.1 

(0.1) 

2.8 

(0.2) 

3.7 

(0.0) 

4.2 

(0.0) 

4.2 

(0.0) 

5.0 

(0.0) 

Norway 

2.8 

(0.1) 

1.5 

(0.2) 

0.7 

(0.8) 

2.3 

(0.0) 

3.0 

(0.0) 

3.0 

(0.0) 

4.5 

(0.0) 

Poland 

3.4 

(0.0) 

0.6 

(0.0) 

3.0 

(0.0) 

3.0 

(0.0) 

3.8 

(0.0) 

3.8 

(0.0) 

4.5 

(0.0) 

Portugal 

3.3 

(0.1) 

1.5 

(0.1) 

1.5 

(0.0) 

2.9 

(0.3) 

3.3 

(0.0) 

3.3 

(0.0) 

6.0 

(0.0) 

Slovak Republic 

3.3 

(0.1) 

1,7 

(0.1) 

1,5 

(0.0) 

2.3 

(0.6) 

3,8 

(0.0) 

3,8 

(0.0) 

4,5 

(0.4) 

Spain 

2,9 

(0.0) 

0,7 

(0.0) 

2.0 

(0.2) 

2.5 

(0,0) 

3.3 

(0,0) 

3.3 

(0.0) 

4.0 

(0.4) 

Sweden 

2,7 

(0.0) 

1.3 

(0.2) 

1.7 

(0.2) 

2.5 

(0.0) 

3,0 

(0.0) 

3,0 

(0.0) 

4,0 

(0.0) 

Switzerland 

3.3 

(0.1) 

1.4 

(0.1) 

0.8 

(0,9) 

3,0 

(0.0) 

3.8 

(0.0) 

3.8 

(0.0) 

5.0 

(0.5) 

Turkey 

3.3 

(0.1) 

1.1 

(0.1) 

2.0 

(0.7) 

2.7 

(0.1) 

3.8 

(0.0) 

3.8 

(0.0) 

5.3 

(0.8) 

United States 

3.7 

(0.1) 

2.3 

(0.1) 

0.7 

(0.6) 

2.7 

(0.3) 

4.5 

(0.0) 

4.5 

(0.0) 

7.5 

(0.0) 

OECD average 

3.3 

(0.0) 

1.4 

(0.0) 

1.6 

(0.1) 

2.7 

(0.0) 

i.7 

(0.0) 

i.7 

(0.0) 

S.i 

(0.1) 

Partners 















Brazil 

3.5 

(0.1) 

1.8 

(0.2) 

1.7 

(0.1) 

3.0 

(0.2) 

4.2 

(0.0) 

4.2 

(0.0) 

5.0 

(0.0) 

Hong Kong- China 

4.5 

(0.1) 

1.9 

(0.1) 

2.0 

(0.4) 

3.5 

(0.0) 

5.3 

(0.0) 

5.3 

(0.0) 

7.0 

(0.0) 

Indonesia 

3.9 

(0.1) 

2.4 

(0.1) 

1.3 

(0.3) 

2.3 

(0.1) 

4.5 

(0.0) 

4.5 

(0.0) 

6.0 

(0.0) 

Latvia 

3.6 

(0.1) 

1.3 

(0.2) 

2.0 

(0.0) 

3.3 

(0.0) 

4.0 

(0.0) 

4.0 

(0.0) 

4.7 

(0.0) 

Liechtenstein 

3.6 

(0.0) 

0.8 

(0.0) 

2.3 

(0.0) 

3.0 

(0.0) 

3.8 

(0.0) 

3.8 

(0.0) 

5.3 

(0.0) 

Macao-China 

4,5 

(0.0) 

1.4 

(0.1) 

2.7 

(0.0) 

4.0 

(0.0) 

5.3 

(0.0) 

5.3 

(0.0) 

6.7 

(0.5) 

Russian Fed, 

3.4 

(0.1) 

1.3 

(0.1) 

1.5 

(O.S) 

2.7 

(0.4) 

4.0 

(0,0) 

4.0 

(0,0) 

5.3 

(0.2) 

Serbia 

2,7 

(0.0) 

1.7 

(0.2) 

1,5 

(0.7) 

2.3 

(0.0) 

3.0 

(0,0) 

3.0 

(0,0) 

3.8 

(0.0) 

Thailand 

3,7 

(0,0) 

1,1 

(0.0) 

1.7 

(0.0) 

3.0 

(0.4) 

4.2 

(0.2) 

4.2 

(0.2) 

5,0 

(0.1) 

Tunisia 

4,2 

(0.0) 

1.4 

(0.2) 

3.7 

(0,2) 

4,0 

(0,0) 

4,0 

(0.0) 

4.0 

(0.0) 

5.0 

(0.0) 

Uruguav 

3.1 

(0.1) 

2,2 

(0.2) 

1,3 

(0.0) 

2.3 

(0.0) 

3.5 

(0.2) 

3.5 

(0.2) 

4.5 

(0.0) 

United Kingdom 

3.4 

(0.0) 

1.4 

(0.1) 

2.3 

(0.1) 

3,0 

(0.0) 

3.5 

(0,1) 

3,5 

(0.1) 

5,0 

(0.3) 


1 , Response rate too low to ensure comparability. 
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Annex A; Pescn'ptive Statistics 


Table A. 5 

Hours per week, of homework or other study set by teachers in total: mean, standard deviation and 
percentile distribution among schools 




Schools at the . , . 




Standard 

5th 

25th 

50th 

75th 

95th 


Mean 

deviation 

percentile 

percentile 

percentile 

percentile 

percentile 


Mean 

S.E. 

S.D. 

S.E. 

pS 

S.E. 

p25 

S.E. 

p50 

S.E. 

p75 

S.E. 

p95 

S.E. 

OECD 















Australia 

5.7 

(0.1) 

2,1 

(0.1) 

2.9 

(0.1) 

4.0 

(0.1) 

7.1 

(0.2) 

7.1 

(0.2) 

9,6 

(0.2) 

Austria 

3.9 

(0.1) 

1.6 

(0.1) 

1.5 

(0.2) 

2.8 

(0.1) 

4.9 

(0.2) 

4.9 

(0.2) 

6.4 

(0.7) 

Belgium 

6.1 

(0.1) 

2.4 

(0.1) 

2.4 

(0.2) 

4.1 

(0.2) 

7.6 

(0.1) 

7.6 

(0.1) 

10.4 

(O.S) 

Canada 

5.7 

(0.1) 

2.3 

(0.1) 

2.6 

(0.1) 

4.0 

(0.1) 

7.1 

(0.3) 

7.1 

(0.3) 

10.1 

(0.2) 

Czech Republic 

3.8 

(0.1) 

1.7 

(0.2) 

1.8 

(0.1) 

2.6 

(0.2) 

4.6 

(0.2) 

4.6 

(0.2) 

6.5 

(0.3) 

Denmark 

5.4 

(0.1) 

1.4 

(0.1) 

3.5 

(0.1) 

4.5 

(0.1) 

6.0 

(0.2) 

6.0 

(0.2) 

7.4 

(0.3) 

Finland 

3.7 

(0.1) 

0,9 

(0.0) 

2,3 

(0.1) 

3,0 

(0.1) 

4,2 

(0.1) 

4.2 

(0.1) 

5,3 

(0.2) 

France 

6.7 

(0.1) 

1.9 

(0.1) 

3.8 

(0.4) 

5,3 

(0.1) 

8,1 

(0.2) 

8.1 

(0.2) 

9.8 

(0.1) 

Germany 

6.2 

(0.1) 

1,7 

(0.1) 

3.2 

(0.2) 

4.9 

(0.2) 

7.4 

(0.1) 

7.4 

(0.1) 

8.9 

(0.3) 

Greece 

8.3 

(0.2) 

2,7 

(0.1) 

3.4 

(0.4) 

5.9 

(0.8) 

10.2 

(0.3) 

10.2 

(0.3) 

12,3 

(0.5) 

Hungary 

9.9 

(0.2) 

3,4 

(0.2) 

4.1 

(0.3) 

7.7 

(0.4) 

12.4 

(0.2) 

12.4 

(0.2) 

15,3 

(0.1) 

Iceland 

4.6 

(0.0) 

1.5 

(0.0) 

2.4 

(0.0) 

3.4 

(0.0) 

5,7 

(0.0) 

5.7 

(0.0) 

7.2 

(0.0) 

Ireland 

7.7 

(0.2) 

2.0 

(0.1) 

4.7 

(0.3) 

6.3 

(0.1) 

9.1 

(0.2) 

9.1 

(0.2) 

10.6 

(0.5) 

Italy 

10.5 

(0.2) 

4.3 

(0.2) 

3.6 

(O.S) 

7.5 

(0.3) 

13.4 

(0.3) 

13.4 

(0.3) 

18.7 

(1.1) 

Japan 

3.8 

(0.2) 

3.3 

(0.4) 

1.0 

(0.1) 

1.8 

(0.1) 

4.6 

(0.6) 

4.6 

(0.6) 

9.5 

(1.3) 

Korea 

3.5 

(0.1) 

1.7 

(0.4) 

1.5 

(0.0) 

2.5 

(0.2) 

4.3 

(0.1) 

4.3 

(0.1) 

5.7 

(0.6) 

Luxembourg 

6.0 

(0.0) 

1.0 

(0.0) 

4.8 

(0.0) 

5.4 

(0.0) 

6.9 

(0.0) 

6.9 

(0.0) 

7.5 

(0.0) 

Mexico 

5.7 

(0.1) 

2,5 

(0.1) 

2.1 

(0.2) 

4.0 

(0.2) 

7.3 

(0.4) 

7.3 

(0.4) 

10.0 

(0.5) 

Netherlands 

5.7 

(0.1) 

2,3 

(0.1) 

2,5 

(0.1) 

3,6 

(0.2) 

7,4 

(0.2) 

7.4 

(0.2) 

9,5 

(0.3) 

New Zealand 

4.5 

(0.1) 

1,6 

(0.1) 

2,4 

(0.2) 

3,4 

(0.1) 

5,3 

(0.2) 

5.3 

(0.2) 

7,3 

(0.2) 

Norway 

4.8 

(0.1) 

1,3 

(0.1) 

3.0 

(0.2) 

3.9 

(0.2) 

5.6 

(0.1) 

5.6 

(0.1) 

7.1 

(0.3) 

Poland 

8.1 

(0.2) 

2.1 

(0.1) 

5.2 

(0.1) 

6.3 

(0.2) 

9.3 

(0.2) 

9.3 

(0.2) 

11,8 

(0.2) 

Portugal 

4.9 

(0.1) 

1.3 

(0.1) 

2.8 

(0.2) 

3.9 

(0.1) 

5.9 

(0.1) 

5.9 

(0.1) 

7.1 

(0.3) 

Slovak Republic 

8.3 

(0.2) 

2.6 

(0.1) 

5.0 

(0.4) 

6.6 

(0.1) 

9.7 

(0.6) 

9.7 

(0.6) 

12.9 

(0.3) 

Spain 

7.3 

(0.1) 

2.1 

(0.1) 

4.5 

(0.3) 

5.9 

(0.1) 

8.4 

(0.2) 

8.4 

(0.2) 

11.6 

(0.6) 

Sweden 

3.9 

(0.1) 

1.2 

(0.1) 

2.4 

(0.1) 

3.1 

(0.1) 

4.4 

(0.1) 

4.4 

(0.1) 

6.5 

(0.6) 

Switzerland 

4.5 

(0.1) 

1.5 

(0.1) 

2.6 

(0.1) 

3.5 

(0.1) 

5.4 

(0.2) 

5.4 

(0.2) 

7.0 

(0.1) 

Turkey 

5.8 

(0.2) 

1.7 

(0.2) 

3.6 

(0.3) 

4.7 

(0.2) 

6.8 

(0.4) 

6,8 

(0.4) 

9.1 

(0.9) 

United States 

5.6 

(0.1) 

2,2 

(0.1) 

2.6 

(0.2) 

4.0 

(0.1) 

6.9 

(0.3) 

6,9 

(0.3) 

9,4 

(0.3) 

OECD average 

5.9 

(0.0) 

2.0 

(0.0) 

3.1 

(0.0) 

4.4 

(0.0) 

7.! 

(0.0) 

7.1 

(0.0) 

9.3 

(0.1) 

Partners 















Brazil 

4.8 

(0.1) 

1,8 

(0.1) 

2.3 

(0.3) 

3.5 

(0.1) 

5.8 

(0.2) 

5.8 

(0.2) 

8,2 

(1.0) 

Hong Kong- China 

6.7 

(0.2) 

2,8 

(0.1) 

2.2 

(0.3) 

4.5 

(0.4) 

8,3 

(0.4) 

8.3 

(0.4) 

11.9 

(0.7) 

Indonesia 

m 

m 

m 

m 

m 

m 

m 

m 

m 

m 

m 

m 

m 

m 

Latvia 

9.4 

(0.2) 

2,2 

(0.1) 

5.7 

(0.3) 

8.0 

(0.2) 

11,0 

(0.4) 

11.0 

(0.4) 

12.9 

(O.S) 

Liechtenstein 

4.4 

(0.0) 

1.1 

(0.0) 

2.7 

(0.0) 

3.6 

(0.0) 

5.4 

(0.0) 

5.4 

(0.0) 

5.4 

(0.0) 

Macao-China 

7.8 

(0.0) 

3.1 

(0.0) 

3.7 

(0.0) 

5.7 

(0.0) 

9.4 

(0.0) 

9.4 

(0.0) 

13.0 

(0.0) 

Russian Fed. 

12.7 

(0.3) 

3.1 

(0.2) 

6.9 

(0.6) 

10.6 

(0.6) 

14.8 

(0.3) 

14.8 

(0.3) 

17.6 

(0.8) 

Serbia 

5.2 

(0.2) 

2.2 

(0.3) 

2.5 

(0.2) 

3.7 

(0.3) 

6.0 

(0.6) 

6.0 

(0.6) 

9.3 

(1.0) 

Thailand 

6.9 

(0.2) 

2.6 

(0.1) 

3.5 

(0.3) 

4.8 

(0.3) 

8.7 

(0.4) 

8.7 

(0.4) 

11.5 

(0.5) 

Tunisia 

4.7 

(0.1) 

1.9 

(0.1) 

2.4 

(0.2) 

3.3 

(0.1) 

5.7 

(0.3) 

5.7 

(0.3) 

8.5 

(0.4) 

Llruguav 

6.7 

(0.1) 

2.0 

(0.1) 

3.6 

(0.3) 

5.5 

(0.2) 

7.7 

(0.3) 

7.7 

(0.3) 

10.3 

fO.3) 

United Kingdom 

6.0 

(0.1) 

2.0 

(0.1) 

3.4 

(0.1) 

4.3 

(0.2) 

7.3 

(0.2) 

7.3 

(0.2) 

9.5 

(0.3) 


1 . Response rate too low to ensure comparability. 
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Table A .6 

Hours per week of homework or other study set by mathematics teachers: mean, standard deviation and 
percentile distribution among schools 




Schools at the . . . 




Standard 


5th 

25th 

50th 

75th 

9Sth 


Mean 

deviation 

percentile 

percentile 

percentile 

percentile 

percentile 


Mean 

S.E. 

S.D. 

S.E. 


S.E. 

p25 

S.E. 

p50 

S.E. 

p75 

S.E, 

p95 

S.E. 

OECD 















Australia 

2.3 

(0.0) 

0.8 

(0.0) 

1.1 

(O.i) 

1.7 

(0.0) 

2.9 

(0.0) 

2.9 

(0.0) 

3.8 

(0.1) 

Austria 

1.7 

(0.0) 

0.6 

(0.0) 

0.7 

(O.i) 

1.3 

(0.1) 

2.1 

(0.1) 

2.1 

(0.1) 

2.9 

(0.2) 

Belgium 

2.2 

(0.0) 

0.8 

(0.0) 

1.0 

(O.i) 

1.7 

(0.0) 

2.6 

(0.1) 

2,6 

(0.1) 

3.7 

(0.2) 

Canada 

2.8 

(0.1) 

1,1 

(0.0) 

1.4 

(O.i) 

2.1 

(0.1) 

3.5 

(0.1) 

3,5 

(0.1) 

4.8 

(0.1) 

Czech Republic 

1,7 

(0.0) 

0,6 

(0.1) 

0,9 

(0.1) 

1.2 

(O.i) 

2,0 

(0.0) 

2.0 

(0.0) 

2.8 

(0.2) 

Denmark 

2.6 

(0.0) 

0.7 

(0.1) 

1.5 

(0.2) 

2,2 

(0.1) 

2,9 

(0.1) 

2,9 

(0,1) 

3.7 

(0.1) 

Finland 

1.5 

(0.0) 

0.4 

(0.0) 

0.9 

(0.0) 

1.2 

(0.0) 

1.7 

(0.0) 

1.7 

(0.0) 

2.1 

(0.1) 

France 

2.5 

(0.0) 

0.7 

(0.0) 

1.5 

(0.1) 

2.1 

(0.1) 

2.9 

(0.1) 

2.9 

(0.1) 

3.8 

(0.2) 

Germany 

2.6 

(0.1) 

0.7 

(0.1) 

1.5 

(0.1) 

2.1 

(0.0) 

3.1 

(0.1) 

3.1 

(0.1) 

3.7 

(0.3) 

Greece 

3.3 

(0.1) 

1.0 

(0.0) 

1.6 

(0.1) 

2.7 

(0.1) 

4.0 

(0.1) 

4.0 

(0.1) 

4.9 

(0.2) 

Hungary 

3.3 

(0.1) 

0.8 

(0.0) 

2.0 

(0.2) 

2.8 

(0.1) 

3.8 

(0.0) 

3.8 

(0.0) 

4.3 

(0.1) 

Iceland 

2.3 

(0.0) 

0.7 

(0.0) 

1,1 

(0.0) 

1.8 

(0.0) 

2.7 

(0.0) 

2.7 

(0.0) 

3.6 

(0.0) 

Ireland 

2.8 

(0.1) 

0.6 

(0.0) 

1.9 

(0.1) 

2,4 

(0.1) 

3.2 

(0.1) 

3.2 

(0,1) 

4.0 

(0.1) 

Italy 

3.5 

(0.1) 

1.2 

(0.1) 

1,7 

(0.1) 

2.7 

(0.1) 

4.3 

(0.2) 

4,3 

(0,2) 

5.3 

(0.3) 

Japan 

1.9 

(0.1) 

1.5 

(0.2) 

0,6 

(0.2) 

1,0 

(0.0) 

2,5 

(0.3) 

2.5 

(0.3) 

5,3 

(0.7) 

Korea 

1,7 

(0.1) 

0,8 

(0.1) 

0.7 

(0.0) 

1,1 

(0.0) 

2.1 

(0.1) 

2.1 

(0.1) 

3,1 

(0,2) 

Luxembourg 

2,3 

(0.0) 

0.3 

(0.0) 

1,9 

(0.0) 

2,2 

(0.0) 

2.5 

(0.0) 

2.5 

(0.0) 

2.7 

(0.0) 

Mexico 

3.2 

(0.1) 

1.2 

(0.1) 

1.5 

(0.1) 

2.4 

(0.1) 

3.8 

(0.1) 

3.8 

(0.1) 

5.2 

(0.2) 

Netherlands 

1.9 

(0.0) 

0.5 

(0.0) 

1.0 

(0.1) 

1.5 

(0.1) 

2.3 

(0.1) 

2.3 

(0.1) 

2.7 

(0.1) 

New Zealand 

1.7 

(0.0) 

0.6 

(0.0) 

0.9 

(0.1) 

1.3 

(0.1) 

2.1 

(0.0) 

2.1 

(0.0) 

2.9 

(0.1) 

Norway 

1.8 

(0.0) 

0.5 

(0.0) 

1.1 

(0.1) 

1.5 

(0.0) 

2.1 

(0.1) 

2.1 

(0.1) 

3.0 

(0.4) 

Poland 

4.1 

(0.1) 

1.1 

(0.1) 

2.7 

(0.2) 

3.4 

(0.2) 

4.8 

(0.1) 

4.8 

(0.1) 

6.0 

(0.2) 

Portugal 

2.0 

(0.0) 

0.5 

(0.0) 

1.4 

(0.1) 

1,7 

(0.1) 

2,4 

(0.1) 

2.4 

(0,1) 

2.8 

(0.2) 

Slovak Republic 

3.1 

(0.1) 

0,9 

(0.0) 

1.8 

(0.1) 

2,6 

(0.1) 

3,8 

(0.1) 

3.8 

(0.1) 

4.5 

(0.1) 

Spain 

2.9 

(0.1) 

0,8 

(0.0) 

1.8 

(0.0) 

2,4 

(0.1) 

3,5 

(0.1) 

3.5 

(0.1) 

4.1 

(0.2) 

Sweden 

1.3 

(0.0) 

0.5 

(0.0) 

0.7 

(0.0) 

0.9 

(0.0) 

1.5 

(0.1) 

1.5 

(0.1) 

2.3 

(0,2) 

Switzerland 

1.9 

(0.0) 

0.7 

(0.0) 

0.9 

(0.1) 

1.4 

(0.1) 

2,3 

(0.1) 

2.3 

(0.1) 

3.1 

(0.2) 

Turkey 

2.8 

(0.1) 

0.7 

(0.0) 

1,7 

(0.1) 

2,3 

(0.1) 

3,3 

(0.2) 

3.3 

(0.2) 

3.9 

(0.1) 

United States 

2.7 

(0.1) 

0.9 

(0.0) 

1.4 

(0.1) 

2,1 

(0.1) 

3.4 

(0.1) 

3.4 

(0.1) 

4.3 

(0,2) 

OECD average 

2.4 

(0.0) 

0.8 

(0.0) 

1.3 

(0.0) 

L9 

(0.0) 

2.9 

(0.0) 

2.9 

(0.0) 

3.8 

(0.0) 

Partners 















Brazil 

2.4 

(0.1) 

0.9 

(0.0) 

1.3 

(0.0) 

1.8 

(0.0) 

2.9 

(0.1) 

2,9 

(0.1) 

3.9 

(0.2) 

Hong Kong-China 

3.1 

(0.1) 

1.2 

(0.1) 

1.2 

(0.1) 

2.2 

(0.1) 

3.7 

(0.2) 

3.7 

(0.2) 

5.4 

(0.4) 

Indonesia 

m 

m 

m 

m 

m 

m 

m 

m 

m 

m 

m 

m 

m 

m 

Latvia 

3.7 

(0.1) 

0.8 

(0.0) 

2.5 

(0.1) 

3.1 

(0.1) 

4.3 

(0.1) 

4.3 

(0.1) 

5.0 

(0.1) 

Liechtenstein 

1.7 

(0.0) 

0.5 

(0.0) 

1.2 

(0.2) 

1.4 

(0.0) 

1.8 

(0.1) 

1.8 

(0.1) 

2.2 

(0.0) 

Macao-China 

4.3 

(0.0) 

1.6 

(0.0) 

2.0 

(0.0) 

3.1 

(0.0) 

5.3 

(0.0) 

5.3 

(0.0) 

7.3 

(0.0) 

Russian Fed. 

5.0 

(0.1) 

1.2 

(0.1) 

3.1 

(0.3) 

4.2 

(0.2) 

5.7 

(0.1) 

5.7 

(0.1) 

7.2 

(0.3) 

Serbia 

2,4 

(0.1) 

0,8 

(0.1) 

1.2 

(0.1) 

1,9 

(0.1) 

2.8 

(0.1) 

2.8 

(0.1) 

3,8 

(0.2) 

Thailand 

4.0 

(0.1) 

1.4 

(0.1) 

2,2 

(0.0) 

2,9 

(0.2) 

5.0 

(0.2) 

5.0 

(0.2) 

6,8 

(0.4) 

Tuni.sia 

2.7 

(0.1) 

0.9 

(0.1) 

1.6 

(0.1) 

2.2 

(0.1) 

3.2 

(0.1) 

3.2 

(0.1) 

4.4 

(0.2) 

Uruguay 

2.8 

(0.1) 

0.8 

(0.1) 

1.7 

(0.1) 

2.3 

(0.1) 

3.4 

(0.1) 

3.4 

(0.1) 

3.9 

(0.1) 

United Kingdom 

2.0 

(0.0) 

0,6 

(0.0) 

1,2 

(0.1) 

1.6 

(0.1) 

2,3 

(0.0) 

2.3 

(0.0) 

3,3 

(0.1) 


1 . Response rate too low to ensure comparability. 
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Annex A; Pescn'ptive Statistics 


Table A. 7 

School principals’ views on mathematics teachers’ support for innovative teaching practices 



Percentage 

of school principals agreeing 

or strong! 

V agreeing with the following 

statements: 


Mathematics teachers are interested 

There is 

a preference among 

There are frequent disagreements 


in trying new methods and 

mathematics teachers to stay with 

between ‘ 

innovative” and 


teaching practices, 

well-known 

methods a 

nd practices. 

“traditional” mathematics teachers. 


% 

S.E. 

% 


S.E. 

% 

S.E. 

OECD 








Australia 

75.2 

(2.8) 

70.3 


(2.8) 

26.6 

(2.8) 

Austria 

83.2 

(3.0) 

36.2 


(3.8) 

12.1 

(2.5) 

Belgium 

74.5 

(2.7) 

66.4 


(2.6) 

34.0 

(3.2) 

Canada 

85.2 

(1.7) 

74.7 


(2.1) 

24.3 

(2.1) 

Czech Republic 

92.8 

(1.8) 

59.9 


(3.1) 

11.6 

(2.2) 

Denmark 

93,5 

(1.6) 

42,6 


(3.6) 

18.7 

(3.2) 

Finland 

74.4 

(3.4) 

42.7 


(3.7) 

16,8 

(3.0) 

France 

w 

w 

w 


w 

w 

w 

Germany 

11.1 

(2.6) 

35,7 


(3.0) 

23.7 

(3.0) 

Greece 

84,6 

(3.2) 

67,5 


(4.2) 

20.5 

(4.6) 

Hungary 

94.1 

(1.6) 

89,2 


(2.5) 

6.2 

(1.7) 

Iceland 

86.1 

(0.1) 

48.7 


(0.2) 

13.8 

(0.1) 

Ireland 

72.5 

(3.6) 

76.4 


(4.1) 

11,9 

(2.6) 

Italy 

87,9 

(2.4) 

79,6 


(3.0) 

24.8 

(3.5) 

Japan 

63.2 

(4.0) 

35,2 


(3.9) 

8.4 

(2.5) 

Korea 

87,0 

(2.8) 

71,2 


(3.7) 

20.2 

(3.3) 

Luxembourg 

68.7 

(0.1) 

81,9 


(0.0) 

29,0 

(0.1) 

Mexico 

87,0 

(1.6) 

74,8 


(3.0) 

53.3 

(3.1) 

Netherlands 

58.8 

(4.4) 

56.2 


(4.2) 

26,1 

(4.0) 

New Zealand 

83.7 

(2.8) 

53,8 


(3.6) 

14.7 

(2.2) 

Norway 

84,0 

(2.7) 

54.0 


(3.7) 

28,8 

(3.9) 

Poland 

92.5 

(2.2) 

20.5 


(3.4) 

11.9 

(2.5) 

Portugal 

90.4 

(3.4) 

36.9 


(4.4) 

34.6 

(4.6) 

Slovak Republic 

97,1 

(1.0) 

86,0 


(2.2) 

12,3 

(2.7) 

Spain 

88.1 

(2.4) 

59,9 


(3.3) 

20.6 

(3.5) 

Sweden 

83.2 

(2.8) 

54.3 


(3.5) 

29.9 

(3.6) 

Switzerland 

78,3 

(3.5) 

52,9 


(4.3) 

18,3 

(2.4) 

Turkey 

79.9 

(4.1) 

85.8 


(3.0) 

36.8 

(4.4) 

United States 

86.7 

(2.4) 

75.3 


(2.9) 

25.8 

(2.8) 

OECD average 

82.9 

(O.S) 

59.8 


(0.6) 

21.6 

(0.6) 

Partners 








Brazil 

90.3 

(2.3) 

58.3 


(3.6) 

34.6 

(3.5) 

Hong Kong-China 

94.7 

(1.9) 

85,8 


(2.7) 

17,0 

(3.2) 

Indonesia 

98.1 

(1.2) 

53.6 


(3.6) 

50,7 

(3.9) 

Latvia 

97.6 

(1.2) 

78.1 


(3.8) 

14,4 

(2.8) 

Liechtenstein 

97.9 

(0.0) 

47.9 


(0.4) 

0.0 

(0.0) 

Macao- China 

99.4 

(0.0) 

79,2 


(0.2) 

3.9 

(0.1) 

Russian Fed. 

96.5 

(1.3) 

92.8 


(2.4) 

12.2 

(2.0) 

Serbia 

88.1 

(2.6) 

68.7 


(4.0) 

19.5 

(3.6) 

Thailand 

95,2 

(1.7) 

90.8 


(2.5) 

28,2 

(3.4) 

Tuni.sia 

92,1 

(2.3) 

97,9 


(1.2) 

32.7 

(4.0) 

Uruguay 

84,0 

(3.6) 

42,2 


(4.7) 

36.1 

(4.3) 

United Kingdom 

92.2 

(1.7) 

46.2 


(3.3) 

11.8 

(2.1) 


1 . Response rate too low to ensure comparability. 
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Table A. 8 

School principals’ perceptions of mathematics teachers’ expectation; 



Percentage 

of school principals agreeing or strongly 

agreeing with the following statements: 


1 here is consensus among 

1 here is consensus 

among 

Ihere are frequent 

disagreements 


mathematics teachers that 

mathematics teachers that 

between mathematics teachers who 


academic achievement must be kept 

It is best to adapt academic standards 

consider each other to be 


as high as p 

ossible. 

to the students’ level and needs. 

“too demanding’ 

or “too lax”. 


% 

S.E. 

% 

S.E. 

% 

S.E. 

OECD 







Australia 

96,8 

(1.1) 

73.4 

(2.3) 

12.2 

(2.2) 

Austria 

87,0 

(2.7) 

44,7 

(3.9) 

14.3 

(2.8) 

Belgium 

84,2 

(2.S) 

58.6 

(3.6) 

27.9 

(2.9) 

Canada 

95. 2 

(1.3) 

59,1 

(2.2) 

21.3 

(2.0) 

Czech Republic 

91,9 

(1.7) 

61.0 

(3.2) 

11.1 

(2.0) 

Denmark 

99.3 

(0.5) 

92.4 

(2.1) 

3.3 

(1.3) 

Finland 

92,9 

(2.0) 

76.2 

(3.2) 

10,6 

(2.6) 

France 

w 

\y 

w 

w 

w 

w 

Germany 

89,1 

(1.8) 

22.7 

(2.6) 

16.3 

(3.0) 

Greece 

85,1 

(3.7) 

79.1 

(4.0) 

24.7 

(4.9) 

Hungary 

84,1 

(3.0) 

73.8 

(3.4) 

16.1 

(3.0) 

Iceland 

99,0 

(0.0) 

67.8 

(0.2) 

13.7 

(0.1) 

Ireland 

93,9 

(2.1) 

83.6 

(2.9) 

11.3 

(2.9) 

Italy 

87,4 

(2.3) 

73.0 

(3.3) 

34.1 

(3.6) 

Japan 

72,3 

(3.8) 

68.8 

(4.0) 

3.0 

(1.5) 

Korea 

85,8 

(2.9) 

97.2 

(1.4) 

13.8 

(2.9) 

Luxembourg 

100.0 

(0.0) 

16.3 

(0.0) 

40.6 

(0.1) 

Mexico 

86,7 

(2.6) 

69,4 

(3.7) 

54.1 

(3.0) 

Netherlands 

96,2 

(1.5) 

73.4 

(3.8) 

23.7 

(4.2) 

New Zealand 

95,4 

(1.7) 

83.2 

(2.6) 

8.3 

(2.2) 

Norway 

98,2 

(1.0) 

87.7 

(2.4) 

9.5 

(2.4) 

Poland 

94,6 

(1.8) 

96.2 

(1.6) 

14.5 

(2.6) 

Portugal 

61,2 

(4.3) 

81,4 

(3.7) 

39.9 

(4.1) 

Slovak Republic 

91,9 

(1.8) 

64,5 

(3.7) 

19.8 

(3.1) 

Spain 

87.5 

(2.7) 

81.5 

(3.4) 

16.9 

(3.3) 

Sweden 

56.5 

(3.6) 

90.9 

(2.0) 

21.7 

(3.1) 

Switzerland 

91.2 

(3.2) 

41.5 

(4.0) 

10.3 

(1.9) 

Turkey 

77.8 

(4.1) 

84.1 

(3.7) 

43.6 

(3.9) 

United States 

98,4 

(0.9) 

66.2 

(3.0) 

20.0 

(3.1) 

OECD average 

88.9 

(0.4) 

70.6 

(0.6) 

19.4 

(0.5) 

Partners 







Brazil 

78.3 

(3.4) 

80.1 

(2.7) 

38.4 

(3,3) 

Hong Kong- China 

93.8 

(2.0) 

95.4 

(1.7) 

11.8 

(2.8) 

Indonesia 

99.8 

(0.1) 

99.1 

(0.4) 

30.9 

(3.5) 

Latvia 

92,3 

(2.3) 

84.2 

(3.1) 

11.7 

(2.9) 

Liechtenstein 

89,3 

(0.4) 

30.8 

(0.5) 

9.5 

(0.1) 

Macao-China 

85,1 

(0.2) 

85.4 

(0.2) 

9.8 

(0.1) 

Russian Fed. 

92,9 

(2.1) 

96.1 

(2.1) 

25.0 

(3.8) 

Serbia 

89,6 

(2.9) 

88.0 

(2.8) 

38,7 

(3.3) 

Thailand 

88,3 

(2.8) 

94,7 

(2.1) 

38.3 

(3.5) 

Tunisia 

98,0 

(1.1) 

88,7 

(2.6) 

51.2 

(4.2) 

Llruguav 

88,9 

(2.3) 

58.6 

(4.2) 

40.3 

(4.2) 

United Kingdom 

97,8 

(1.1) 

80.7 

(2.4) 

6.0 

(1.7) 


1. Response rate too low to ensure comparability. 


M^them^tics Teaching and Learning Strategi 


PISA ©oecDzolo 


155 


Annex A; Pesci-iptive Statistics 


Annex A; Pescn'ptive Statistics 


Table A. 9 

School principals’ perceptions of mathematics teachers’ support of teaching goals 


Percentage of school principals agreeing or strongly agreeing with the following statements; 



There is consensus among 
mathematics teachers that the social 
and emotional development of the 
student is as important as their 
acquisition of mathematical skills and 
knowledge in mathematics classes. 

There is consensus among 
mathematics teachers that 
the development of students’ 
mathematical skills and knowledge 
is the most important objective in 
mathematics classes. 

There are frequent disagreements 
between mathematics teachers who 
consider each other as “too focused 
on skill acquisition” or “too focused 
on the affective development” 
of the student, 


% 

S.E. 

% 

S.E. 

% 

S.E. 

OECD 







Australia 

74.8 

(2.7) 

83.0 

(2.2) 

13.0 

(2.3) 

Austria 

62.7 

(3.7) 

71.9 

(3.5) 

9,4 

(2.4) 

Belgium 

62.5 

(2.8) 

76.7 

(2.9) 

16.2 

(2.6) 

Canada 

66,5 

(2.3) 

87.2 

(1.5) 

12.3 

(1.5) 

Czech Republic 

76,3 

(2.7) 

76.3 

(3.0) 

9.4 

(2.0) 

Denmark 

60,9 

(3.4) 

77,5 

(2.7) 

7.0 

(1.8) 

Finland 

65,3 

(3.6) 

75.9 

(3.4) 

9.5 

(2.2) 

France 

w 

w 

w 

w 

w 

w 

Germany 

73,2 

(3.2) 

79.7 

(2.9) 

7.1 

(1.4) 

Greece 

78,7 

(4.7) 

76.5 

(4.3) 

15.7 

(3.9) 

Hungary 

75,4 

(3.7) 

84.6 

(2.6) 

8.3 

(2.2) 

Iceland 

80,8 

(0.2) 

93.3 

(0.1) 

13.8 

(0.1) 

Ireland 

71.6 

(4.0) 

76.3 

(4.0) 

11.7 

(2.5) 

Italy 

73.3 

(3.0) 

78.6 

(3.1) 

23.0 

(3.1) 

Japan 

66,8 

(4.6) 

57,8 

(4.1) 

0.0 

(0.0) 

Korea 

93,1 

(2.0) 

82.7 

(3.2) 

10.2 

(2.4) 

Luxembourg 

50,7 

(0.1) 

89,5 

(0.1) 

18.5 

(0,1) 

Mexico 

86,5 

(2.3) 

79.4 

(3.4) 

46.7 

(2.9) 

Netherlands 

44,2 

(4.6) 

87,0 

(3.3) 

13.2 

(3.2) 

New Zealand 

61,9 

(3.2) 

88,8 

(2.0) 

5.1 

(1.4) 

Norway 

70,0 

(3.4) 

89,2 

(2.8) 

12.7 

(2.6) 

Poland 

95.5 

(1.7) 

66,8 

(3.4) 

9.4 

(2.3) 

Portugal 

63.0 

(4.5) 

80.1 

(3.7) 

18.7 

(3.7) 

Slovak Republic 

88,8 

(2.1) 

75.0 

(2.5) 

15.6 

(3,1) 

Spain 

78,4 

(3.3) 

81.9 

(2.9) 

11.3 

(2.8) 

Sweden 

70,1 

(3.5) 

92.1 

(2.1) 

14.2 

(2.6) 

Switzerland 

74.5 

(3.9) 

76,9 

(3.3) 

8.1 

(1.5) 

Turkey 

84,2 

(3.9) 

81,4 

(3.8) 

32.6 

(4.3) 

United States 

70.2 

(3.1) 

91,5 

(1.9) 

10.2 

(2.2) 

OECD average 

71.7 

(0.6) 

80.8 

(0.5) 

13.3 

(0.5) 

Partners 







Brazil 

84,5 

(2.9) 

67.7 

(3.3) 

24.2 

(3,3) 

Hong Kong-China 

17.7 

(3.4) 

90,8 

(2.4) 

6.5 

(2.1) 

Indonesia 

94,0 

(1.7) 

96,0 

(1.3) 

35.2 

(3.6) 

Latvia 

86,2 

(2.9) 

78,7 

(3.8) 

8.2 

(2.4) 

Liechtenstein 

64,2 

(0.4) 

83,1 

(0.4) 

0.0 

(0.0) 

Macao- China 

85,7 

(0.2) 

78.8 

(0.1) 

5.6 

(0.1) 

Russian Fed. 

91.4 

(2.3) 

85.2 

(2.2) 

19.1 

(2.9) 

Serbia 

62.9 

(4.4) 

85.2 

(3.5) 

17.0 

(2.9) 

Thailand 

99.3 

(0.6) 

95.9 

(1.6) 

27.5 

(3,6) 

Tunisia 

70,3 

(3.8) 

91.8 

(2.3) 

32.2 

(3.8) 

Uruguay 

76,6 

(3.3) 

69.0 

(2,6) 

24.5 

(4.0) 

United Kingdom 

58.5 

(4.0) 

86.3 

(2.3) 

2.3 

(0.9) 


1 . Response rate too low to ensure comparability. 
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Table A. 10 

Streaming of students in some or all mathematics classes 


Different classes study different content 

Mathematics classes study similar content. or sets of mathematics topics 

but at different levels of difficulty that have different levels ot difficulty 


For all classes 

For 

some classes 

Not for 
anv classes 

For all classes 

For 

some classes 

Not for 
anv classes 

% 

S.E. 

% 

S.E. 

% 

S.E. 

% 

S.E. 

% 

S.E. 

% 

S.E. 

OECD 













Australia 

32.2 

(3.1) 

56.8 

(2.9) 

11.0 

(2.0) 

22.9 

(2.8) 

60.4 

(3.2) 

16.7 

(2.6) 

Austria 

16.3 

(1.9) 

13.7 

(2.7) 

70.1 

(2.1) 

m 

m 

m 

m 

m 

m 

Belgium 

4.4 

(1.3) 

46.8 

(3.1) 

48.8 

(3.0) 

16.8 

(1.8) 

44.1 

(2.9) 

39.1 

(3.1) 

Canada 

26.6 

(2.2) 

54.4 

(2.2) 

19.1 

(2.0) 

33.4 

(1.9) 

52.5 

(2.1) 

14.0 

(1.6) 

Czech Republic 

7.6 

(1.7) 

17,6 

(2.5) 

74,7 

(2.8) 

8,7 

(2.3) 

23.7 

(3.1) 

67.6 

(3.5) 

Denmark 

23.0 

(3.4) 

23.3 

(3.7) 

53.7 

(4.1) 

14,7 

(2,8) 

23.6 

(3.5) 

61,8 

(3,3) 

Finland 

10.9 

(2.2) 

27,6 

(3,7) 

61.5 

(3.8) 

1.4 

(0,9) 

32,7 

(3.5) 

66,0 

(3.5) 

France 

w 

AV 

w 

w 

w 

w 

w 

w 

w 

w 

w 

w 

Germany 

24,2 

(2.9) 

18.2 

(2.8) 

57.5 

(3.2) 

12,2 

(2.5) 

16.6 

(2.6) 

71,2 

(2.9) 

Greece 

6.2 

(3.0) 

12,8 

(3.6) 

80,9 

(3.5) 

0.0 

(0.0) 

4.7 

(2.2) 

95.3 

(2.2) 

Hungary 

19.3 

(3.S) 

37.3 

(4.0) 

43.4 

(4.0) 

5.7 

(2.0) 

24.1 

(3.4) 

70.1 

(3.7) 

Iceland 

52.7 

(0.2) 

19,2 

(0.1) 

28.2 

(0.2) 

22.9 

(0.1) 

34.7 

(0.2) 

42 .4 

(0.2) 

Ireland 

60.9 

(4.4) 

34.4 

(4.4) 

4.7 

(1.9) 

27.0 

(4.0) 

45.8 

(4.3) 

27.1 

(4.0) 

Italy 

21.5 

(2.7) 

34.0 

(3,5) 

44.5 

(3,1) 

9.8 

(2.2) 

45.6 

(3.4) 

44,6 

(3.6) 

Japan 

13,7 

(2.6) 

29.8 

(3.8) 

56.6 

(4.4) 

3.4 

(1,5) 

23.9 

(3,3) 

72.7 

(3.5) 

Korea 

10,9 

(2.8) 

60,2 

(4.5) 

28.9 

(3.8) 

2.3 

(1.3) 

55.0 

(4.1) 

42 .7 

(4.0) 

Luxembourg 

4,3 

(0,0) 

41.8 

(0.1) 

54.0 

(0.1) 

19,0 

(0.0) 

41.3 

(0.1) 

39.7 

(0.1) 

Mexico 

15,6 

(2.4) 

56.3 

(3.7) 

28.0 

(3.3) 

13.5 

(1.8) 

57.2 

(3,3) 

29.3 

(3.0) 

Netherlands 

34,8 

(4.4) 

42.4 

(4.2) 

22.7 

(3,6) 

39.7 

(4.2) 

38.7 

(4.1) 

21.6 

(3.8) 

New Zealand 

37,0 

(3.S) 

59,8 

(3.4) 

3.2 

(1.2) 

14.6 

(2.4) 

76.8 

(3.0) 

8.7 

(2.1) 

Norway 

78.1 

(3.S) 

14.2 

(2.9) 

7.6 

(2.0) 

8.0 

(2.2) 

17.3 

(3.3) 

74.7 

(3.7) 

Poland 

41.9 

(3.8) 

38.2 

(3.9) 

20.0 

(3.2) 

1.0 

(0.7) 

21.1 

(3.1) 

78.0 

(3.2) 

Portugal 

32.3 

(4.1) 

39.5 

(4.3) 

28.2 

(4.3) 

0.7 

(0.5) 

9.8 

(2.2) 

89.5 

(2,2) 

Slovak Republic 

44,2 

(3,7) 

25.8 

(3.1) 

30.0 

(3.4) 

11.8 

(2.9) 

21.7 

(2.6) 

66.5 

(3.5) 

Spain 

33.3 

(3.6) 

58,3 

(3.5) 

8.4 

(2.4) 

6.9 

(1,8) 

50,5 

(3.9) 

42,5 

(3.9) 

Sweden 

50.7 

(3.9) 

39.6 

(3,9) 

9.7 

(2.2) 

12.4 

(2.6) 

45.2 

(4,0) 

42,4 

(3.7) 

Switzerland 

19.9 

(2.3) 

46.6 

(4.1) 

33.5 

(3.9) 

20.7 

(3.3) 

34.9 

(3,9) 

44.4 

(3.6) 

Turkey 

33,2 

(4.4) 

41,9 

(4.7) 

24,9 

(3.6) 

23.5 

(4.0) 

39,9 

(4.1) 

36.6 

(4.2) 

United States 

25.4 

(3.0) 

65.5 

(3.3) 

9.1 

(2.0) 

31.4 

(3.2) 

56,2 

(3.3) 

12.4 

(2.3) 

OECD average 

29.S 

(0.6) 

37.0 

(0.6) 

33.3 

(0.6) 

14.8 

(O.S) 

37.1 

(0.6) 

48.1 

(0.6) 

Partners 













Brazil 

44.3 

(3.5) 

28,7 

(3,3) 

27.0 

(3.4) 

29.8 

(3.3) 

27.4 

(3.7) 

42,8 

(3,7) 

Hong Kong-China 

15.9 

(3.2) 

70.3 

(4,0) 

13.8 

(3.2) 

14.1 

(2.9) 

54.7 

(4.3) 

31,2 

(4.1) 

Indonesia 

46.9 

(3.1) 

24,4 

(3,5) 

28.7 

(3,3) 

31,0 

(3.3) 

17.8 

(2.8) 

51.2 

(3.7) 

Latvia 

34.3 

(4.9) 

52,4 

(5.1) 

13.3 

(3.3) 

13.1 

(3,2) 

47,0 

(4.8) 

39,8 

(4.7) 

Liechtenstein 

21.6 

(0.5) 

37,0 

(0.4) 

41.4 

(0.4) 

11.2 

(0.5) 

70.4 

(0.5) 

18,3 

(0,2) 

Macao-China 

7.2 

(0.0) 

40,6 

(0.2) 

52.2 

(0.2) 

17,9 

(0.2) 

32.2 

(0.2) 

49,9 

(0.2) 

Russian Fed. 

33.4 

(3.4) 

56,1 

(3.9) 

10.6 

(2.6) 

24.1 

(3.4) 

40.5 

(3.8) 

34.8 

(4.1) 

Serbia 

1 5.7 

(3.2) 

61.0 

(4,3) 

23.3 

(3,8) 

15.7 

(3,2) 

55.9 

(4.5) 

28.4 

(3.9) 

Thailand 

27.6 

(3.8) 

41.9 

(4.0) 

30.5 

(4.2) 

36.6 

(4.6) 

34.1 

(4.1) 

29,3 

(4.0) 

Tunisia 

36.1 

(3.9) 

11.4 

(2.3) 

52.5 

(3,9) 

Ml 

(3.6) 

12.7 

(2.7) 

69.6 

(4.1) 

Llruguav 

13.3 

(2.5) 

56.9 

(4.1) 

29.8 

(4.3) 

7,6 

(1,8) 

35,6 

(4.6) 

56.9 

(4,5) 

United Kingdom 

82.3 

(2.2) 

16.1 

(2.2) 

1.6 

(0.3) 

29.0 

(3.6) 

40.5 

(3.9) 

30.5 

(3.7) 


1 . Response rate too low to ensure comparability. 
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Annex A; Pescn'ptive Statistics 


Table A. 11 

Ability grouping within mathematics classes 


In mathematics classes, teachers use a pedagogy 


Students are grouped by ability suitable for students with heterogeneous abilities 

within their mathematics classes (i.e. students are not grouped bv ability) 


For all classes 

For 

some classes 

Not for 
any classes 

For all classes 

For 

some classes 

Not for 
any classes 

% 

S.E. 

% 

S.E. 

% 

S.E. 

% 

S.E. 

% 

S.E. 

% 

S.E. 

OECD 













Australia 

49,6 

(3.1) 

34,4 

(2.9) 

16.1 

(2,3) 

18.1 

(2,5) 

44.5 

(3,0) 

37,4 

(3,0) 

Austria 

7.7 

(2.0) 

19.7 

(3.0) 

72,5 

(2.7) 

23.7 

(3.2) 

40,0 

(3.2) 

36.3 

(3.8) 

Belgium 

2.1 

(0.7) 

16.7 

(2.5) 

81,1 

(2.5) 

50.2 

(3.2) 

31,3 

(3.1) 

18.5 

(2.1) 

Canada 

18.4 

(2.0) 

34.6 

(2.4) 

47,0 

(2.5) 

37.0 

(2.2) 

38,8 

(2.1) 

24.2 

(2.1) 

Czech Republic 

13.1 

(2.2) 

28,8 

(3.2) 

58.2 

(3.1) 

53.4 

(3.5) 

30.7 

(3.0) 

15.8 

(2.4) 

Denmark 

5.4 

(1.8) 

15.2 

(2.8) 

79.3 

(2.9) 

73.8 

(3.1) 

18.2 

(3.1) 

8.0 

(1.6) 

Finland 

7.0 

(2.0) 

36.2 

(3.9) 

56.8 

(4.3) 

39.9 

(3.9) 

45.7 

(4.3) 

14.4 

(2.9) 

France 

w 

w 

w 

w 

w 

w 

w 

w 

w 

w 

w 

w 

Germany 

11.2 

(2.3) 

34.6 

(3.6) 

54.2 

(3.5) 

35.2 

(3.6) 

17.0 

(2.4) 

47.8 

(3.6) 

Greece 

0.6 

(O.S) 

1.3 

(1.1) 

98,1 

(1.3) 

62.0 

(4.7) 

12.6 

(3.9) 

25,4 

(4.1) 

Hungary 

15.2 

(2.9) 

38.9 

(4.2) 

45.9 

(4.3) 

49.2 

(4.4) 

38.6 

(4.0) 

12.1 

(2.5) 

Iceland 

23.3 

(0.1) 

46.4 

(0.2) 

30,4 

(0.2) 

47.9 

(0.2) 

39,2 

(0.2) 

12.9 

(0.1) 

Ireland 

49.3 

(4.2) 

28,1 

(4.2) 

22.6 

(3.7) 

27.1 

(4.2) 

42,7 

(4,6) 

30.3 

(4.1) 

Italy 

2.7 

(1.4) 

21.4 

(3.2) 

75.8 

(3.5) 

39,1 

(3.3) 

37.3 

(3.6) 

23,7 

(2.8) 

Japan 

13.8 

(2.7) 

22.4 

(3.5) 

63.7 

(4.2) 

19.6 

(3.5) 

18.7 

(3.3) 

61.7 

(3.9) 

Korea 

5.9 

(1.9) 

64.6 

(3.9) 

29.5 

(3.8) 

14.9 

(2.7) 

69.4 

(4.0) 

15.7 

(3.1) 

Luxembourg 

0.0 

(0.0) 

6.9 

(0.0) 

93.1 

(0.0) 

46.2 

(0.1) 

34.0 

(0.1) 

19.7 

(0.0) 

Mexico 

8.1 

(1.7) 

40.5 

(3.5) 

51.4 

(3.3) 

32.1 

(3.4) 

41.5 

(3.3) 

26.4 

(3.2) 

Netherlands 

11.5 

(2.5) 

44.8 

(4.4) 

43.8 

(4.7) 

29.7 

(4.1) 

39.1 

(4.4) 

31.2 

(4.0) 

New Zealand 

19.3 

(2.9) 

66.1 

(3.4) 

14.6 

(2.5) 

23.5 

(2.9) 

57.5 

(3.5) 

19.0 

(2.9) 

Norway 

4.7 

(1.7) 

22.1 

(3.2) 

73.2 

(3.6) 

78.0 

(3.4) 

16.1 

(3,0) 

5.9 

(1.9) 

Poland 

3.5 

(1.5) 

17,7 

(3.1) 

78.9 

(3.4) 

73.3 

(3.3) 

18.9 

(3.0) 

7.8 

(2.2) 

Portugal 

0.5 

(0.5) 

13,8 

(2.8) 

85.8 

(2.9) 

67.5 

(4.2) 

16.9 

(3.0) 

15.6 

(3.1) 

Slovak Republic 

8.0 

(1.6) 

26.8 

(3.5) 

65.2 

(3.4) 

53.3 

(3.5) 

22,5 

(3.2) 

24.3 

(2.8) 

Spain 

8.3 

(1.4) 

33.7 

(3.2) 

58.1 

(3.1) 

51,0 

(3.6) 

32.7 

(3.1) 

16.3 

(2.9) 

Sweden 

22.3 

(3.4) 

44,8 

(3.5) 

33.0 

(3.6) 

34.0 

(4.0) 

45.2 

(3.7) 

20.8 

(3.1) 

Switzerland 

13.9 

(2.6) 

27.5 

(3.6) 

58.6 

(3.3) 

42.2 

(3.8) 

28.9 

(3.8) 

28.9 

(3.5) 

Turkey 

8.0 

(2.7) 

16.9 

(3.6) 

75.1 

(4.3) 

12.4 

(3.0) 

27.5 

(4.2) 

60.1 

(5.1) 

United States 

21.9 

(3.3) 

45.7 

(3.6) 

32.4 

(3.1) 

14.2 

(2.3) 

46.6 

(3.8) 

39.2 

(3.8) 

OECD average 

14.0 

(0.4) 

30.3 

(0.6) 

55.7 

(0.6) 

39.9 

(0.6) 

33.6 

(0.6) 

26.5 

(0.6) 

Partners 













Brazil 

5.8 

(1.7) 

8.9 

(2.4) 

85.3 

(2.6) 

30.4 

(3.2) 

16.5 

(3.0) 

53.1 

(3.7) 

Hong Kong- China 

3.7 

(1.6) 

32.0 

(3.9) 

64.4 

(3.9) 

34.5 

(3.9) 

47.1 

(4.5) 

18.4 

(3.1) 

Indonesia 

9.3 

(2.3) 

12.3 

(2.1) 

78.4 

(3.1) 

76.3 

(3.3) 

10.0 

(2.3) 

13.8 

(2.7) 

Latyia 

5.1 

(1.8) 

71.2 

(3.3) 

23.7 

(3.1) 

43.7 

(4,4) 

52.1 

(4.3) 

4.2 

(1.7) 

Liechtenstein 

25.4 

(0.5) 

35.8 

(0.4) 

38.8 

(0.4) 

33.1 

(0.4) 

33.7 

(0.4) 

33.1 

(0.5) 

Macao-China 

0.0 

(0.0) 

12.7 

(0.2) 

87.3 

(0.2) 

63.4 

(0.2) 

17.2 

(0.2) 

19.4 

(0.2) 

Russian Fed, 

8.3 

(2.1) 

71,4 

(4.1) 

20.3 

(4.0) 

43.1 

(4.3) 

53,6 

(4.6) 

3.3 

(1.6) 

Serbia 

0.0 

(0.0) 

56.0 

(4.9) 

44.0 

(4.9) 

14.6 

(3.3) 

64.2 

(4.3) 

21.2 

(3.8) 

Thailand 

13.2 

(2.6) 

43,5 

(3.6) 

43.3 

(3.6) 

35.5 

(3.6) 

48.6 

(3.8) 

16.0 

(2,7) 

Tunisia 

6.3 

(2.0) 

11.1 

(2.8) 

82.6 

(3.1) 

63.6 

(4.3) 

7.9 

(2.4) 

28.5 

(3.8) 

Uruguay 

0.0 

(0.0) 

11.9 

(2.5) 

88.1 

(2.5) 

44.3 

(3.6) 

44.2 

(3.6) 

11.5 

(2.4) 

United Kingdom 

50.6 

(3.1) 

27,3 

(3.1) 

22,1 

(2.9) 

9.2 

(2.0) 

22,0 

(3.2) 

68,8 

(3.7) 


1 . Response rate too low to ensure comparability. 
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Table A. 12 

Methods of assessment 



Standardised tests 

Teacher tests 

Teacher ratings 

Student portfolios 

Student assignments 




More 



More 



More 



More 



More 




than 



than 



than 



than 



than 


I -2 times 

3 times 

1 -2 times 

3 times 

1-2 times 

3 times 

1-2 times 

3 times 

1 -2 times 

3 times 


a year 

a year 

a year 

a year 

a year 

a year 

a year 

a year 

a year 

a year 


% 

S.E, 

% 

S.E. 

% 

S.E, 

% 

S.E. 

% 

S.E, 

% 

S.E. 

% 

S.E. 

% 

S.E, 

% 

S.E, 

% 

S.E, 

OECD 





















Australia 

49,8 

(3.3) 

11.3 

(2.0) 

3,3 

(1.2) 

96.2 

(1.3) 

16,5 

(2.2) 

76,2 

(2.5) 

36.4 

(3.0) 

40,4 

(2.7) 

1.3 

(0.7) 

98.2 

(0.8) 

Au.stria 

19,8 

(3.2) 

11.9 

(2,6) 

7.7 

(2.2) 

92.3 

(2.2) 

4,6 

(2.1) 

95,4 

(2.1) 

42,5 

(4.1) 

43,5 

(4.0) 

9.6 

(2.3) 

89.0 

(2.4) 

Belgium 

20,5 

(2.8) 

9.5 

(1.9) 

8.2 

(1.5) 

90.9 

(1.6) 

4.2 

(1.1) 

90.5 

(1.8) 

34,9 

(3.0) 

42,5 

(3,0) 

3.8 

(1.2) 

95.0 

(1.4) 

Canada 

70.6 

(1.8) 

12.6 

(1.5) 

1.0 

(0.5) 

99,0 

(0.5) 

8,7 

(1.3) 

73.8 

(2.1) 

41,8 

(2.2) 

38,6 

(2.3) 

2.1 

(0.7) 

97.9 

(0.7) 

Czech Republic 

69.1 

(3.2) 

9.3 

(1.7) 

6.3 

(1.6) 

93.3 

(1.6) 

15,0 

(2.2) 

81,7 

(2.6) 

30,3 

(2.9) 

65,4 

(3.0) 

8.0 

(2.1) 

91.9 

(2.1) 

Denmark 

70.8 

(3.0) 

16.4 

(3.0) 

31.3 

(3.4) 

65.3 

(3.3) 

44.2 

(3.8) 

55,0 

(3.7) 

11.8 

(2.4) 

81,9 

(2.9) 

11.1 

(2.2) 

88.0 

(2.1) 

Finland 

83.2 

(2.9) 

16.5 

(2.9) 

0.0 

(0.0) 

100.0 

(0.0) 

39.5 

(3.6) 

55,9 

(3.8) 

57.2 

(3.8) 

16,3 

(3.1) 

11.6 

(2.5) 

88.4 

(2.5) 

France 

w 

w 

\v 

w 

w 

w 

w 

w 

w 

w 

w 

w 

w 

w 

w 

w 

w 

w 

w 

w 

Germany 

37.1 

(3.2) 

6.3 

(1,5) 

4.0 

(1.5) 

96.0 

(1.5) 

9,0 

(1.9) 

89,5 

(2,2) 

45.1 

(3.6) 

52,9 

(3.7) 

9.0 

(2.0) 

90,4 

(2.1) 

Greece 

32.4 

(S.+) 

32,0 

(5.8) 

8.0 

(2,5) 

92,0 

(2,5) 

43,8 

(5.1) 

56,2 

(5,1) 

37,7 

(4.8) 

17,0 

(4.1) 

54.1 

(5.4) 

14.7 

(4.3) 

Hungary 

71.7 

(4.0) 

18.9 

(3,4) 

1.3 

(0.8) 

98,5 

(0.9) 

14.2 

(2.6) 

82,5 

(3.0) 

51.0 

(4,1) 

47,4 

(4.2) 

1.2 

(0.8) 

98,8 

(0.8) 

Iceland 

84.8 

(0.2) 

14.6 

(0.1) 

5.0 

(0.1) 

95,0 

(0.1) 

8.5 

(0.1) 

91,5 

(0.1) 

19,0 

(0.2) 

80,3 

(0.2) 

4.0 

(0.1) 

96.0 

(0.1) 

Ireland 

44.8 

(4.S) 

10.5 

(2.8) 

25.6 

(4.2) 

74.4 

(4.2) 

22,9 

(3.7) 

72.7 

(4.0) 

48.2 

(4.3) 

13.3 

(3.0) 

2.7 

(1.4) 

94.5 

(1.8) 

Italy 

38.2 

(3.4) 

38.2 

(3.4) 

5.6 

(1.7) 

93,4 

(1.8) 

7.8 

(1.8) 

85.0 

(2.7) 

20,3 

(2.5) 

76,0 

(2.8) 

8.7 

(1.8) 

90,0 

(1.9) 

Japan 

32.7 

(4.2) 

24.1 

(3.4) 

0.7 

(0.7) 

99,3 

(0.7) 

15.5 

(3.3) 

79,8 

(3.6) 

15.4 

(3.3) 

84,6 

(3.3) 

18.0 

(3.4) 

82,0 

(3.4) 

Korea 

36.1 

(4.0) 

58.7 

(3.8) 

2.4 

(1.4) 

97.6 

(1.4) 

32.7 

(3.9) 

66.6 

(4.0) 

46.7 

(4.5) 

44,4 

(4.7) 

34.2 

(4.2) 

65.4 

(4.2) 

Luxembourg 

82.4 

(O.i) 

10.7 

(0.0) 

7.6 

(0.0) 

84.3 

(0,1) 

5.3 

(0.0) 

84.4 

(0,0) 

33,5 

(0.1) 

41,0 

(0,1) 

10,0 

(0.0) 

87.6 

(0.0) 

Mexico 

34,5 

(3.4) 

40,6 

(3.4) 

8.1 

(1.5) 

88.2 

(2.0) 

24.7 

(2.5) 

55.4 

(3,1) 

18,1 

(2.2) 

75,2 

(2.7) 

19.1 

(2.5) 

75,0 

(3.0) 

Netherlands 

30,9 

(4.5) 

44,2 

(4.4) 

0.0 

(0,0) 

99,5 

(0,5) 

20,2 

(3.3) 

52.1 

(4,3) 

28,2 

(3,9) 

16.4 

(3,3) 

8,7 

(2,2) 

89,9 

(2.4) 

New Zealand 

29.4 

(3.1) 

51,6 

(3.3) 

4.6 

(1.4) 

95,4 

(1.4) 

22.7 

(2.8) 

66,3 

(2,9) 

50.8 

(3,5) 

39,7 

(3.5) 

5.9 

(1.5) 

91.6 

(2,0) 

Norway 

64.9 

(4.1) 

29,7 

(3.5) 

0.0 

(0,0) 

100.0 

(0.0) 

21.1 

(3,3) 

78,9 

(3.3) 

30,6 

(3.9) 

23.4 

(3.7) 

4,4 

(1,6) 

95.0 

(1.5) 

Poland 

73.5 

(3.6) 

20.1 

(3.0) 

6.6 

(1.8) 

93,4 

(1.8) 

21.2 

(3.2) 

13.2 

(2.9) 

37.3 

(3.7) 

26,7 

(3.4) 

4.2 

(1.6) 

95.8 

(1.6) 

Portugal 

82.6 

(3.5) 

0.0 

(0.0) 

0.0 

(0.0) 

100.0 

(0.0) 

0.6 

(0.6) 

99.4 

(0.6) 

38.4 

(4.8) 

20,6 

(3.6) 

7.7 

(2.4) 

92,3 

(2.4) 

Slovak Republic 

59,2 

(3.1) 

16,5 

(3.2) 

6.9 

(1.4) 

93.1 

(1.4) 

5.1 

(1.6) 

94,9 

(1.6) 

46.5 

(3.6) 

43.7 

(3.6) 

14.6 

(2.3) 

84,8 

(2.3) 

Spain 

30.5 

(3.3) 

36,4 

(3.3) 

0.0 

(0.0) 

100.0 

(0.0) 

4.0 

(1.2) 

88.3 

(2.2) 

3.0 

(0.9) 

96.0 

(1.0) 

2.9 

(1.1) 

97,1 

(1.1) 

Sweden 

55.9 

(4.1) 

41.0 

(4.1) 

2.1 

(1.0) 

96.2 

(1.5) 

9.8 

(2.4) 

89,0 

(2.6) 

26.0 

(3.6) 

13.1 

(2.8) 

3.4 

(1.4) 

94.6 

(1.8) 

Switzerland 

38.7 

(4.2) 

11.1 

(2.4) 

2.0 

(0.7) 

97.8 

(0.7) 

13.6 

(2.2) 

84.5 

(2.3) 

32.3 

(3.8) 

17.7 

(2.4) 

14.0 

(2.3) 

85.3 

(2.3) 

Turkey 

44.9 

(5.3) 

42,6 

(5.0) 

42,6 

(4,1) 

40,0 

(4.5) 

51.8 

(4.9) 

42,1 

(4.8) 

54.8 

(4,9) 

32,0 

(4.2) 

62.9 

(4,5) 

35,5 

(4.6) 

United States 

77,1 

(3.0) 

21,3 

(2.8) 

0,5 

(0.5) 

99,5 

(0.5) 

4,2 

(1.4) 

95,1 

(1.5) 

47.2 

(3.7) 

32,3 

(3.3) 

0.5 

(0,5) 

99,5 

(0.5) 

OECD average 

52,6 

(0.7) 

23.0 

(06) 

7.2 

(0.3) 

914 

(0.3) 

17.8 

(0,5) 

74.8 

(0.6) 

36.0 

(0.6) 

43.3 

(0.6) 

II.9 

(0.4) 

86.! 

(0.4) 

Partners 





















Brazil 

27.2 

(3.0) 

33.1 

(3.4) 

1.3 

(0.8) 

96,6 

(1.2) 

5.2 

(1.9) 

90.3 

(2,2) 

3.1 

(1.3) 

94.4 

(1.8) 

1.7 

(1.0) 

96.6 

(1.4) 

Hong Kong-China 

m 

m 

m 

m 

5.9 

(2.0) 

94.1 

(2.0) 

48.7 

(4.8) 

35.3 

(4.2) 

44.5 

(4.2) 

16.5 

(3.4) 

25.1 

(3.8) 

74.9 

(3.8) 

Indonesia 

50,0 

(3.8) 

16.1 

(2.9) 

6.4 

(1.4) 

77,5 

(3.3) 

40.9 

(3.4) 

53,4 

(3.4) 

24.5 

(4.1) 

27,8 

(3.4) 

2.4 

(1.3) 

91.8 

[2.0) 

Latvia 

50,2 

(4.0) 

49,4 

(4,0) 

3.3 

(1.3) 

96,7 

(1.3) 

5,9 

(2.1) 

92.5 

(2.4) 

28.3 

(3.7) 

71.3 

(3.7) 

11,3 

(2.7) 

88,1 

[2.8) 

Liechtenstein 

74.0 

(0.5) 

9,5 

(0.1) 

0.0 

(0,0) 

100.0 

(0,0) 

17.7 

(0.4) 

82.3 

(0.4) 

73,7 

(0.3) 

21.0 

(0.3) 

13,0 

(0,5) 

87,0 

(0,5) 

Macao- China 

m 

m 

m 

m 

2.4 

(0.0) 

97.6 

(0.0) 

26.9 

(0.2) 

62,6 

(0.2) 

28,4 

(0.3) 

42,5 

(0.3) 

16,0 

(0.1) 

84,0 

(0.1) 

Russian Fed. 

54.8 

(4.3) 

26,8 

(3.9) 

5.2 

(1.8) 

94.6 

(1.8) 

19.7 

(3.0) 

68,3 

(2.9) 

32.3 

(4.1) 

42.3 

(4.5) 

21,6 

(3.2) 

78,2 

(3.2) 

Serbia 

35.6 

(4.1) 

6.8 

(2.4) 

32.3 

(3.9) 

67,1 

(4.0) 

2.7 

(1.4) 

95,6 

(17) 

13.9 

(3.1) 

5.9 

(1.5) 

50.5 

(4.3) 

40,0 

(4.2) 

Thailand 

80.6 

(3.5) 

3.6 

(1.4) 

15.4 

(2.9) 

78,3 

(3.4) 

58,3 

(4.1) 

29,9 

(3.4) 

47,4 

(4.5) 

37.4 

(4.0) 

13.2 

(2.8) 

83,7 

(3.0) 

Tunisia 

16.7 

(3.3) 

56,8 

(4.1) 

5.3 

(1.6) 

87,4 

(2.4) 

8.1 

(2.5) 

70,4 

(3.9) 

33.4 

(4.0) 

40.9 

(4.1) 

2 3.7 

(3.8) 

63,5 

(4.1) 

LIruguav 

25.3 

(3.4) 

6.4 

(2.1) 

0.8 

(0.5) 

99.2 

(0.5) 

4.6 

(1.6) 

94.2 

(1.8) 

13.5 

(2.5) 

24.8 

(2.4) 

15.2 

(3.4) 

84.8 

(3.4) 

United Kingdom 

60.2 

(lii 

10.9 

(2A 

18,3 

(27) 

81,6 

(27) 

23.5 

(37) 

74.3 

(37) 

58,1 

(37) 

31,8 

(ML 

6.1 

(17) 

93,8 

(17) 


1 . Response rate too low to ensure comparability. 
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Annex A; Pesci-iptive Statistics 


Annex A; Pescn'ptive Statistics 


Table A. 13 

Use of assessment results 



Inform 
parents about 
their child’s 
progress 

Student 

retention/ 

promotion 

Group 

students 

Compare 
to national 
standards 

School’s 

progress 

Teachers’ 

effectiveness 

Improve 

curriculum 

Compare to 
other schools 


% 

S.E. 

% 

S.E. 

% 

S.E. 

% 

S.E. 

% 

S.E. 

% 

S.E. 

% 

S.E. 

% 

S.E. 

OECD 

















Australia 

100.0 

(0.0) 

61.5 

(2.9) 

77.8 

(2.6) 

54.9 

(2.4) 

76,5 

(2.7) 

34.0 

(2.9) 

81,5 

(2.5) 

38.7 

(2.7) 

Austria 

92.2 

(2.2) 

93.2 

(2.3) 

31,8 

(2,3) 

12.4 

(2.8) 

59,2 

(3.9) 

35.6 

(3,5) 

65,6 

(3,7) 

38.0 

(3.9) 

Belgium 

99.6 

(0.4) 

99,1 

(0.6) 

19,9 

(2.4) 

9.6 

(2.2) 

37,6 

(2.8) 

19.4 

(2.4) 

66,1 

(3.0) 

6.9 

(1.7) 

Canada 

99.4 

(0.3) 

95.5 

(1.0) 

72,0 

(2.1) 

70,1 

(2.2) 

79.5 

(1.8) 

31,4 

(2.4) 

84.1 

(1.8) 

53.0 

(2.4) 

Czech Republic 

98.3 

(0,9) 

91,8 

(1.9) 

35.2 

(3.3) 

50.0 

(3.3) 

85,6 

(2.4) 

61.7 

(3.4) 

88,7 

(2.1) 

55.3 

(3.7) 

Denmark 

67.6 

(3.S) 

3.8 

(0.9) 

14.1 

(2.6) 

5.9 

(1.7) 

8,4 

(2.0) 

3.7 

(1.4) 

46.7 

(3.9) 

2.9 

(1.3) 

Finland 

100.0 

(0.0) 

95,2 

(0.9) 

17.1 

(3.0) 

56.3 

(4.0) 

65.0 

(4.1) 

32.1 

(3.5) 

65,6 

(3.6) 

34.9 

(3.5) 

Germany 

96.1 

(1.4) 

96.3 

(1.2) 

35.8 

(3.0) 

21.2 

(3.2) 

44,0 

(3.2) 

11.8 

(2.3) 

44,8 

(3.9) 

17.1 

(2.7) 

Greece 

96.6 

(2.0) 

99.4 

(0.5) 

11.1 

(2.1) 

12.2 

(2.8) 

35.6 

(5.7) 

15.2 

(4.4) 

40.5 

(5.3) 

15.8 

(3.0) 

Hungary 

99.1 

(0.9) 

94.7 

(1.9) 

34.8 

(3.5) 

86.4 

(2.6) 

95.8 

(1.4) 

77.0 

(3.5) 

93.7 

(2.1) 

77.5 

(3.2) 

Iceland 

99.7 

(0.0) 

14.8 

(0.1) 

56.1 

(0.2) 

84.1 

(0.1) 

88.1 

(0.1) 

30.9 

(0,2) 

96.6 

(0.0) 

65.6 

(0.2) 

Ireland 

99.3 

(0,7) 

43.7 

(4.2) 

78.1 

(3,3) 

17.2 

(3.2) 

49.5 

(4.0) 

16.9 

(3.2) 

42.2 

(4.3) 

8.8 

(2,6) 

Italy 

96.0 

(1.3) 

83.7 

(2.8) 

51.5 

(3.9) 

32.8 

(3.4) 

69,3 

(3.0) 

23.3 

(3.2) 

83,8 

(2.9) 

29.1 

(3.2) 

Japan 

98.3 

(1.0) 

89.5 

(2.6) 

44.7 

(4.5) 

17.8 

(3.4) 

47.7 

(4.4) 

81.5 

(3.3) 

78,9 

(3.4) 

11.8 

(2.8) 

Korea 

95.5 

(1,8) 

24.8 

(3.8) 

62.6 

(4.0) 

62.0 

(3.7) 

58,6 

(4.0) 

54,5 

(4.3) 

90.2 

(2.7) 

54.9 

(3.9) 

Luxembourg 

100.0 

(0,0) 

100.0 

(0.0) 

29.7 

(0.1) 

21.8 

(0.0) 

26,1 

(0.1) 

21,0 

(0,0) 

62,9 

(0.1) 

10.3 

(0,0) 

Mexico 

96.7 

(0.9) 

92.9 

(1.8) 

59.4 

(3.2) 

55.5 

(3.1) 

91,2 

(1.6) 

77.3 

(3.1) 

89,2 

(2.2) 

50.5 

(3.5) 

Netherlands 

99.5 

(0.5) 

96.8 

(1.6) 

88.7 

(2.7) 

63.5 

(4.1) 

63.3 

(4.2) 

42.2 

(4.4) 

71.8 

(3.9) 

47.0 

(4.4) 

New Zealand 

98.4 

(1.0) 

77.9 

(2.8) 

73.7 

(3.0) 

86.7 

(2.3) 

95,6 

(1.6) 

53.0 

(3.4) 

95,8 

(1.2) 

73.5 

(3.2) 

Norway 

100.0 

(0.0) 

m 

m 

37.8 

(4.0) 

63.8 

(3.6) 

67.7 

(3.3) 

19.5 

(3.0) 

70.1 

(3.5) 

47.1 

(3.8) 

Poland 

98.0 

(1.1) 

84.2 

(2.8) 

33.0 

(4.1) 

71.1 

(3.7) 

96.6 

(1.5) 

73.2 

(3.2) 

87.8 

(2.8) 

62.3 

(3.6) 

Portugal 

98.8 

(0.7) 

96.6 

(1.6) 

26.1 

(3.8) 

32.9 

(4.2) 

78.5 

(3.1) 

34.7 

(4.4) 

84.3 

(3.2) 

22.3 

(3.4) 

Slovak Republic 

98.7 

(0.7) 

96.7 

(1.0) 

54.9 

(3.8) 

45.9 

(3.7) 

95.0 

(1.5) 

75,0 

(2.7) 

89.0 

(2,2) 

47,7 

(3.1) 

Spain 

99.7 

(0.3) 

99,5 

(0.3) 

47.6 

(3.5) 

18.2 

(2.1) 

68,6 

(3.2) 

35,9 

(3,5) 

88,5 

(2.3) 

17.2 

(2.1) 

Sweden 

94.1 

(1.6) 

95.2 

(1.5) 

28.1 

(3.2) 

18,5 

(2.0) 

24.9 

(4.5) 

36,8 

(3.5) 

51.9 

(3.6) 

15,9 

(3.7) 

Switzerland 

96.4 

(1.5) 

38.9 

(4.1) 

45.2 

(4.0) 

73.0 

(3.1) 

85.4 

(2.7) 

21,2 

(3.1) 

80.7 

(3.0) 

64,8 

(3.5) 

Turkey 

84.8 

(3.0) 

71.1 

(4.2) 

50,8 

(4.3) 

58,7 

(4.4) 

76.3 

(3.3) 

33.8 

(4.4) 

34.0 

(3.7) 

58.9 

(4.4) 

United States 

98.4 

(0.8) 

76.3 

(2.8) 

65.9 

(3.3) 

90.7 

(1.9) 

93.5 

(1.6) 

54.7 

(3.1) 

92,0 

(1.9) 

80,3 

(2.8) 

OECD average 

96.6 

(0.2) 

77.9 

(0.4) 

47.5 

(0.6) 

47.7 

(0.6) 

67.6 

(0.6) 

41. } 

(0.6) 

74.4 

(0.6) 

41. 1 

(0.6) 

Partners 

















Brazil 

87.9 

(2.6) 

83,4 

(2.5) 

44.7 

(4.1) 

37.5 

(3.5) 

75,7 

(3.5) 

55,5 

(3.5) 

92.1 

(2.1) 

23.3 

(2.9) 

Hong Kong-China 

98.7 

(0.9) 

96,3 

(1.5) 

63.3 

(4.2) 

22.7 

(4.0) 

90.5 

(2.5) 

63.9 

(4.0) 

96,9 

(1.2) 

18,9 

(3.1) 

Indonesia 

89.2 

(2.4) 

84.3 

(2.6) 

46.4 

(3.8) 

50.6 

(3.8) 

86.0 

(2.7) 

87.3 

(2.5) 

78,8 

(3.2) 

77,2 

(2.9) 

Latvia 

100.0 

(0.0) 

94.1 

(2.7) 

40.1 

(4.3) 

79.7 

(4.1) 

99.2 

(0.6) 

86.5 

(2.8) 

96,7 

(1.4) 

65.1 

(4.2) 

Liechtenstein 

100.0 

(0.0) 

96.7 

(0.0) 

57.7 

(0.4) 

28.7 

(0.3) 

17.5 

(0.3) 

39.1 

(0.5) 

21.3 

(0.5) 

39.3 

(0.4) 

Macao-China 

96.5 

(0.1) 

96.5 

(0.1) 

43.4 

(0.2) 

3.1 

(0.1) 

81.4 

(0.2) 

81.5 

(0.3) 

97.5 

(0.1) 

14.5 

(0.1) 

Russian Fed. 

100.0 

(0.0) 

96.7 

(1.3) 

55.7 

(4.0) 

69.9 

(4.1) 

96.9 

(1.3) 

98.7 

(0.8) 

98.8 

(0.7) 

81.3 

(3.2) 

Serbia 

92.8 

(2.3) 

88.7 

(2.4) 

19.4 

(3.5) 

42.7 

(4,2) 

76.7 

(3.5) 

51.0 

(4.5) 

64.4 

(4.0) 

50.1 

(4.2) 

Thailand 

89.6 

(2.6) 

71.9 

(4.0) 

77.2 

(3.5) 

59.3 

(3.6) 

88.0 

(3.0) 

70.6 

(3.6) 

76.9 

(3.8) 

56,8 

(4.0) 

Tunisia 

74.8 

(3.4) 

84.3 

(2.9) 

43.6 

(4.3) 

73.1 

(3.6) 

81.8 

(3.4) 

62.7 

(3.7) 

71,9 

(3,2) 

71.7 

(3.4) 

Uruguay 

94.2 

(1.7) 

90.6 

(2.4) 

29,0 

(3.1) 

18.1 

(3.2) 

76.5 

(4.0) 

40,7 

(4.5) 

68,8 

(3.7) 

10.5 

(2.4) 

United Kingdom 

100.0 

(ML 

68.3 

(ML 

93.7 

(MI 

88.9 

(MI 

97.3 

(ML 

85.9 

(MI 

91,4 

(ML 

84.4 

(ML 


1 . Response rate too low to ensure comparability. 


160 


Mathematics Teaching and Learning Strategies in PISA © OECD 20IO 


Annex b 


CORRELATIONS 


M^them^tics Teaching and Learning Strategi 


PISA ©OECD 2010 


161 


Annex B; Con-elations 


Table B,1 

Latent correlations among selected measures used in the teaching and learning analytical model 


Learning strategies and student confidence 


Latent correlations between: 


Control 

strategies 

Control 

strategies 

Elaboration 

strategies 

Self- 

efficacy in 
mathematics 

Self- 

efficacy in 
mathematics 

Anxiety in 
mathematics 

Self- 

efficacy in 
mathematics 

Self- 

efficacy in 
mathematics 

Self- 

efficacy in 
mathematics 

Elaboration 

strategies 

Memo- 

risation/ 

rehearsal 

strategies 

Memo- 

risation/ 

rehearsal 

strategies 

Anxiety in 
mathematics 

Self- 

concept in 
mathematics 

Self- 

concept in 
mathematics 

Memo- 

risation/ 

rehearsal 

strategies 

Elaboration 

strategies 

Control 

strategies 

Australia 

0.75 

0,96 

0.78 

-0.55 

0.72 

-0.78 

0.32 

0.36 

0.30 

Austria 

0,45 

0,84 

0.35 

-0.42 

0,48 

-0.87 

0.00 

0.13 

0.26 

Belgium 

0.62 

0,88 

0,60 

-0.36 

0.43 

-0.82 

0.09 

0.22 

0.23 

Canada 

0.60 

0.89 

0.63 

-0.55 

0.64 

-0.91 

0.25 

0,32 

0,33 

Czech Republic 

0,81 

0,94 

0.83 

-0.57 

0,61 

-0.81 

0,02 

0,16 

0,24 

Denmark 

0.60 

0.95 

0,60 

-0.75 

0.83 

-0.91 

0,05 

0,16 

0.31 

Finland 

0.71 

0,90 

0,68 

-0,64 

0.77 

-0.82 

0,03 

0,12 

0,24 

France 

0.50 

0.81 

0.39 

-0,43 

0,60 

-0,75 

0,38 

0,33 

0,39 

Germany 

0,84 

0.89 

0,73 

-0.49 

0.54 

-0,89 

0.28 

0.34 

0.37 

Greece 

0.65 

0.95 

0.57 

-0.58 

0.73 

-0,87 

0.27 

0.33 

0.43 

Hungary 

0.62 

0.85 

0.60 

-0.43 

0.40 

-0.86 

0.20 

0.29 

0.28 

Iceland 

0.78 

1.03 

0.86 

-0.61 

0.76 

-0.70 

0.35 

0.33 

0.28 

Ireland 

0,81 

1.00 

0.76 

-0.59 

0,67 

-0.84 

0.20 

0.25 

0.36 

Italy 

0,49 

0.94 

0.50 

-0.41 

0,56 

-0.68 

0.10 

0.15 

0.18 

Japan 

0.89 

0,91 

0,86 

-0,45 

0.47 

-0.86 

0,28 

0,27 

0,25 

Korea 

0.56 

0.96 

0.74 

-0.49 

0,69 

-0.83 

0.27 

0.34 

0,33 

Luxembourg 

0.61 

0.87 

0.68 

-0.37 

0.45 

-0.78 

0.12 

0,28 

0.32 

Mexico 

0.80 

0.97 

0,86 

-0,43 

0.52 

-0.77 

0.33 

0,36 

0,37 

Netherlands 

0.75 

0.93 

0.73 

-0.54 

0.61 

-0.85 

0.35 

0.56 

0,50 

New Zealand 

0.62 

0.94 

0.48 

-0.64 

0.72 

-0.83 

0.08 

0.16 

0.24 

Norway 

0.74 

0.78 

0.62 

-0.62 

0.77 

-0.81 

0.41 

0.43 

0.43 

Poland 

0.71 

1.03 

0.75 

-0.57 

0.66 

-0.82 

0.27 

0,17 

0.28 

Portugal 

0.82 

0.80 

0.79 

-0.40 

0.65 

-0.72 

0.45 

0.37 

0,34 

Slovak Republic 

0.43 

0.73 

0.51 

-0.56 

0,60 

-0.87 

0.28 

0.31 

0,28 

Spain 

0.43 

0.76 

0.48 

-0.25 

0.53 

-0.63 

0,14 

0,23 

0.29 

Sweden 

0.92 

0.99 

0,86 

-0.59 

0.77 

-0.78 

0,14 

0,39 

0.38 

Switzerland 

0,63 

0,64 

0.18 

-0.56 

0,61 

-0.85 

0.10 

0.18 

0.24 

Turkey 

0.65 

0.89 

0.62 

-0,47 

0.62 

-0,80 

0.37 

0,25 

0,34 

United Kingdom 

0.75 

0.89 

0.82 

-0,60 

0.73 

-0.80 

0,26 

0,44 

0,40 

United States 

0.79 

0.98 

0.87 

-0.54 

0.55 

-0.86 

0.29 

0.31 

0.27 

OECD 

0.66 

0,90 

0,67 

-0.52 

0,62 

-0.80 

0.23 

0.29 

0.33 
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Latent correlations among selected measures used in the teaching and learning analytical model (continued) 


Approaches to learning and learning environment 


Latent correlations between: 


Competitive 

learning 

Interest in and 
enjoyment of 
mathematics 

Teacher 

support 

Attitudes 
towards school 

Attitudes 
towards school 

Student-teac 

relations 

Co-operative 

learning 

Instrumental 
motivation 
to learn 
mathematics 

Disciplinary 

climate 

Student-teacher 

relations 

Sense of 
belonging at 
school 

Sense of 
belonging 
school 

Australia 

0.20 

0,61 

0.32 

0,63 

0.30 

0.34 

Austria 

0,27 

0,60 

0.18 

0,57 

0.19 

0.16 

Belgium 

0.26 

0,73 

0.12 

0.67 

0.43 

0.37 

Canada 

0.12 

0.67 

0,30 

0,48 

0,39 

0.16 

Czech Republic 

0.08 

0.59 

0.24 

0.59 

0.42 

0.28 

Denmark 

0.31 

0.67 

0.35 

0.73 

0.41 

0.26 

Finland 

-0.01 

0.64 

0.31 

0.55 

0.32 

0.29 

France 

0,23 

0.70 

0,20 

0,58 

0.25 

0.19 

Germany 

0.29 

0,56 

0.23 

0,58 

0.29 

0.26 

Greece 

0.45 

0,66 

0.23 

0,58 

0.38 

0,24 

Hungary 

0.17 

0,67 

0,23 

0.50 

0.26 

0.18 

Iceland 

0.25 

0,68 

0,18 

0.65 

0,32 

0.20 

Ireland 

0.18 

0,60 

0.35 

0.64 

0,37 

0.15 

Italy 

0.24 

0.68 

0.26 

0.60 

0.43 

0.22 

japan 

0.44 

0.68 

0.23 

0.44 

0.45 

0.42 

Korea 

0.84 

0.72 

a 

0.48 

0.34 

0.21 

Luxembourg 

0.29 

0.65 

0.10 

0.68 

0.21 

0,21 

Mexico 

0.70 

0,67 

0,22 

0,36 

0.43 

0,42 

Netherlands 

0.24 

0.59 

0.33 

0,65 

0.43 

0,13 

New Zealand 

0.18 

0,50 

0.35 

0,58 

0,35 

0.25 

Norway 

0.15 

0,68 

0.24 

0.81 

0.35 

0.25 

Poland 

0.35 

0.70 

0,18 

0,53 

0.18 

0.19 

Portugal 

0.57 

0,65 

0,15 

0.38 

0.40 

0.14 

Sloyak Republic 

-0,02 

0.69 

0.07 

0,53 

0.45 

0.28 

Spain 

0.50 

0.72 

0.09 

0,53 

0,33 

0,17 

Sweden 

0.26 

0.59 

0.29 

0,59 

0.39 

0.22 

Switzerland 

0.09 

0,71 

0.08 

0,63 

0.53 

0.40 

Turkey 

0.62 

0,68 

0,05 

0,55 

0.25 

0.25 

United Kingdom 

0.33 

0.62 

0.42 

0.65 

0,33 

0.27 

United States 

0,48 

0,66 

0.25 

a 

a 

a 

OECD 

0.35 

0,61 

0,20 

0.61 

0,37 

0,26 
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Annex C. Bivgi-Ute gn4 Multilevel 


Table C.l 

Multivariate regression coefficients and standard errors 
0 

E 


Score point difference associated with the various factors shown below, before accounting for the other factors 

School characteristics 



School average 
of the highest 
international 
socio- 
economic 
index of 
occupational 
status (HlSEl) 
between both 
parents 



School climate 



classroom climate 


Intercept 

School size 

Attitudes 

towards 

school 

Sense of 
belonging 
at school 

Student- 

teacher 

relations 

Discipli- 

nary 

climate 

School 

average 

disciplinary 

climate 

Teacher 

support 

Coeff. S.E. 

Coeff 

S.E. 

Coeff. S.E. 

Coeff 

S.E. 

Coeff 

S.E. 

Coeff 

S.E. 

Coeff 

S.E. 

Coeff 

S.E. 

Coeff 

S.E. 

OECD 
















Australia ilHA {1.02) 

16.3 


40 (1.17) 

IS 

(0.96) 

-8-6 

(0,97) 

fui 

(0,89) 

AA 

(0.86) 

SA 

(1.01) 

OS 

(1.01) 

Austria 497..1 (1.84) 

26^ 

(1.79) 

1L2 (2.88) 

ss 

(1.02) 

-3.0 

(0,89) 

ALA 

(1.22) 

Si) 

(1.17) 

9A 

(1.46) 

OA 

(1.25) 

Belgium mj. (1-06) 

27J 

(1.83) 

12.7 (2.39) 

-5.1 

(1.1°) 

OS 

(1.31) 

-0.3 

(0.99) 

TA 

(0.91) 

22.0 

(1.25) 

-40 

(1.08) 

Canada 51 S.5 (1.0*^) 

ms 

(O'lll 

Til (0.94) 

iLi 

(0.70) 

=02 

(0.81) 

20 

(0.85) 

AJ 

(0,84) 

40 

(0,83) 

=1A 

(0.85) 

Czech Republic 510. 4 (2.47) 

30.9 

(3.07) 

la (3.97) 

MA 

(1.18) 

ao 

(1.46) 

AS 

(1.25) 

AJ 

(1.00) 

&0 

(1.72) 

=SJ 

(1.26) 

Denmark 5 1 .3. .3 (2.84) 

&A 

n.93) 

12il (4.09) 

1^ 

(1.66) 

ss 

(1.50) 

A^ 

(1.60) 

IS 

(1.49) 

SJ 

(1.41) 

JJ 

(1.54) 

Finland ilX7 


(1.10) 

1L3 (3,22) 

6i) 

(1.27) 

OA 

(1,09) 

iii 

(1.37) 

is 

(1,30) 

AL2 

(1.02) 

OA 

(1.44) 

France w w 

w 

w 

w w 

w 

w 

w 

w 

w 

w 

w 

w 

w 

w 

w 

w 

Germany mj. (1.94) 

ILi 

(2.03) 

CLh (2,46) 

=20 

(1.08) 

OO 

(1.39) 

(L2 

(1.10) 

40 

(1.00) 

12.6 

(1.53) 

OS 

(0.93) 

Greece 4.53.6 (6.89) 

24.8 

(1.56) 

-19.6 (7,27) 

-4.0 

(1.62) 

AS 

(1.41) 

AA 

(1.77) 

lA 

(1.30) 

6.6 

(2.46) 

IJl 

(1.77) 

Hungary £02 (3.07) 

IL3. 

(1.69) 

IS (4.66) 

SO 

(1.35) 

AA 

(1.21) 

AO 

(1.42) 

2J 

(1.16) 

Si) 

(1.2S) 

OO 

(1.17) 

Iceland illU (3.77) 

QJ 

(1.66) 

^ (4,36) 

20 

(1.51) 

JO 

(1.20) 

lO 

(1.45) 

4A 

(1.74) 

lO 

(1.83) 

AU 

(1.84) 

Ireland ilZl fl.74) 

no 

iim 

£iS (3.15) 

H5 

(1,26) 

-8.0 

(1,13) 

20 

(1.31) 

8.6 

(1.35) 

AU 

(1.151 

=11 

(1.47) 

Italy 499.0 (2.00) 

no 

(1.11) 

£2 (3.52) 

Q_3 

(1.36) 

OO 

(1.15) 

=20 

(1.27) 

lO 

(1.06) 

IA 

(0.63) 

JJ 

(1.13) 

Japan 531.2 (2,45) 

31A 

(1.63) 

(1,06) 

OA 

(1.38) 

=AS 

(1,50) 

lO 

(1.59) 

40 

(1.43) 

21.6 

(0,97) 

-SA 

(1.75) 

Korea 556.8 (2.76) 

25.6 

(1.35) 

10.3 (1.40) 

AS 

(1.10) 

SA 

(1.25) 

LI 

(1.35) 

fU 

(1.10) 

120 

(3.57) 

QO 

(1.50) 

Luxembourg 500.7 (2.73) 

2&A 

(1.82) 

J-Q (0,78) 

JJ- 

(1731 

AU 

(1.15) 

IS 

(1.33) 

iA 

(1.07) 

no 

(2.98) 

=AS 

(1.03) 

Mexico 429.4 (7.45) 

llA 

(0.76) 

L2 (1.33) 

TO 

(1.02) 

£L4 

(0,97) 


(1.33) 

SA 

(1.27) 

120 

(0.78) 

-2.0 

(1.11) 

Netherlands 526.5 (2.06) 

36.6 

(2.53) 

11.3 (3,08) 

OS 

(1.34) 

OA 

(1.53) 

lA 

(1.53) 

2-A 

(1.47) 

14.8 

(4.21) 

AJ 

(1.35) 

New Zealand 519.7 (1 .75) 

nn 

(1.64) 

(1.01) 

6.n 

(1.48) 

=&A 

(1.32) 

AJ 

(1.57) 

6.6 

(1.24) 

lO 

(1.48) 

JJ 

(1.30) 

Norway 487.6 (6.54) 

iS 

(1.55) 

SO (7.55) 

lA 

(1.76) 

=8A 

(1.21) 

6.Q 

(1.50) 

SQ 

(1.71) 

40 

(1.38) 

-6.0 

(1.80) 

Poland 4SZS 0^ 

327 

(1,63) 

^ (2,65) 

UJ. 

(1.42) 

-2.0 

(1,11) 

OO 

(1.70) 

AA 

(1.24) 

IS 

(1.36) 

JJ 

(1.331 

Portugal 488.0 (1,53) 

10.7 

(1.27) 

10.2 (0,81) 

lA 

(1.13) 

1-2 

(1.50) 

OS 

(1.43) 


(1.43) 

18.0 

(1.39) 

AO 

(1.29) 

Slovak Republic 493.5 (1 .99) 

25.2 

(0.93) 

(L4 (2,67) 

OS 

(1.20) 

OS 

(1.15) 

OO 

(1.31) 

iA 

(1.09) 

TO 

(0.86) 

SO 

(1.18) 

Spain 507.2 (1.09) 

10.4 

(1.09) 

Ail (2.29) 

All 

(1.22) 

OS 

(1.13) 

OS 

(1.24) 

&0 

(1.06) 

Si) 

(0.83) 

JJ 

(1.32) 

Sweden 49TZ (2,36) 

lA 

(1.66) 

Til (2,89) 

40 

(1.44) 

=3A 

(1.26) 

IS 

(1.38) 

IS 

(1.18) 

AJ 

(1.59) 

=20 

(1.67) 

Switzerland 5.Q.S.5 (3.17) 

18.6 

(1.49) 

£_L (4.51) 

IS 

(1.29) 

OS 

(0.92) 

AS 

(1.31) 

&0 

(2.10) 

9J 

(1.17) 

AA 

(1.50) 

Turkey 481 .5 (3.80) 

27.6 

(1,63) 

IS (2,93) 

oo 

Hill 

£2 

(1,46) 

SA 

iii 

8A 

iii 

240 

(2.14) 

as 

iii 

United States 464.5 (2.13) 

15.n 

(1.37) 

JL2 (1.26) 

ALT 

(1.26) 

m 

m 

IS 

(1.27) 

9J 

(1.28) 

hO 

(0,98) 

JJ 

(1.13) 

Partners 
















Brazil 451 .5 (3.88) 

23.6 

(1.34) 

IS (0,98) 

li) 

(1.41) 

QA 

(1.31) 

OS 

iii 

AJ 

11.76) 

u.s 

i'2,63) 

AS 

(1,63) 

Hong Kong-China 526.2 (3.80) 

20.2 

(1.79) 

62.3 (4.50) 

JLi 

(1.74) 

=hS 

(1.71) 

20 

(1.32) 

AA 

(1.33) 

MO 

(1.62) 

-1,0 

(1.41) 

Indonesia m m 

m 

m 

m m 

m 

m 

m 

m 

ni 

m 

m 

m 

m 

m 

m 

m 

Latvia 480.2 (1.72) 

ILi 

(1.57) 

ns (2,12) 

6^ 

(1.31) 

OA 

(1.75) 

AA 

(1.75) 


(1.74) 

12 

(1.24) 

SA 

(1.80) 

Liechtenstein c c 

c 

c 

c c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

Macao- China 532.8 (6.35) 

12A 

(3.95) 

iii (1,87) 

JLi 

(4.13) 

AJ. 

(4.27) 

IS 

(3.51) 

ILA 

(3.44) 

JAJ 

(5.45) 

=SJ 

(4.06) 

Russian Fed. 465.4 (2.09) 

llA 

(1.63) 

±S (3.25) 

AU 

(1.60) 

QA 

(0.96) 

OA 

(1.39) 

&s 

(1.48) 

2A 

(1.57) 

AU 

(1.31) 

Serbia 450.6 (1.9*5) 

210 

(1.02) 

4J. (0.97) 

Al 

(1.16) 

=1S 

(0.90) 

=20 

(1 A4) 

6,0 

(1.61) 

ITJ 

(1.05) 

JJ 

(1.44) 

Thailand 469.8 (3.58) 

20.1 

(1.25) 

40 (0.43) 

lA 

(1.26) 

0.0 

(1.56) 

OA 

(1.35) 

n.n 

(1.54) 

as 

(1.21) 

AA 

(1.32) 

Tunisia 409.6 (3.07 ) 

20.3 

(0.91) 

6^ (2,06) 

IS 

(0.85) 

lO 

(0.96) 

SO 

(0,94) 

IS 

(1.27) 

no 

(0.81) 

AU 

(1.52) 

Uruguay 458.5 ( 1 .80) 

23.0 

(1.14) 

16.2 (1,26) 

(IS 

(1.61) 

QO 

(1.32) 

-6.0 

(1.48) 

11 

(1.60) 

140 

(1.23) 

JJ 

(1.42) 

United Kingdom' 508.8(1.30) 

13.0 

(1.22) 

TJ: (1,87) 

2S 

(1.24) 

-6.8 

(1.30) 

AJ 

1 1 ,41 ) 

20 

(1,03) 

SJ 

(1.15) 

JJ 

(1.36) 


1_ Response rate too low to ensure comparabilitv. 
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Table C.l 

Multivariate regression coefficients and standard errors (continued) 


Score point difference associated with the various factors shown below, before accounting for the other factors 

Student characteristics 


Home 


background 


Self-related cognitions in mathematics 



The highest 
international 
socio-economic 
index of occu- 
pational status 
(HlSEl) between 
both parents 

The highest 
level of 
education 
between 
both parents 

(HISCED) 

Number of 
books 
in the home 

Anxiety 

in 

mathematics 

Instrumental 

motivation 

in 

mathematics 

Interest in 
and 

enjoyment of 
mathematics 

Self-concept 

in 

mathematics 

Self-efficacv in 
mathematics 


Coeff, 

S.E. 

Coeff 

S.E, 

Coeff 

S.E. 

Coeff 

S,E, 

Coeff 

S.E. 

Coeff 

S,E, 

Coeff 

S,E, 

Coeff 

S,E, 

OECD 

















Australia 


(1.19) 

dU 

(1.25) 

ad 

(0,86) 

dd 

(1.40) 

Id 

(1.41) 

dd 

(1.57) 

24.4 

(1.31) 

ms 

(1.35) 

Austria 

2il 

(1.35) 

-5.0 

(1.50) 

I2d) 

(1.20) 

dd 

(1.49) 

dd 

(1.37) 

=id 

(1.48) 

lid 

(1.68) 

20 4 

(1.22) 

Belgium 

10.5 

(1.26) 

zIL7 

(1.15) 

8.8 

(1.04) 

-dd 

(1.34) 

4.6 

(1.26) 

did 

(1.46) 

13.0 

(1,35) 

24.7 

(1.29) 

Canada 

&J. 

(0,96) 

Id 

(1.48) 

lid 

(0,70) 

=L1 

(1-11) 

id 

(0.94) 

dd 

(1.29) 

18.4 

(1,S6) 

2X4 

(0.93) 

Czech Republic 


(1.63) 

2d 

(2.16) 

lid 

(1.63) 

dd 

(1.65) 

id 

(1.20) 

dd 

(1.81) 

17.0 

(1.75) 

23 8 

(1.27) 

Denmark 


(1.60) 

hd 

(1.76) 

iLi 

(1.46) 

-12.4 

(1.81) 

dd 

(1.87) 

dd 

(2.23) 

24d 

(2,56) 

2X4 

(1.93) 

Finland 

&A 

(1.07) 

Id 

(1.30) 

i2d 

(1,22) 


(1.88) 

id 

(1,46) 

=4d 

(1.79) 

29.8 

(1,94) 

21d 

(1.69) 

France 

w 

w 

w 

w 

w 

w 

w 

w 

w 

w 

w 

w 

w 

w 

w 

w 

Germany 


(1.39) 

2d 

(1.36) 

3d 

(1.15) 

=id 

(1.37) 

id 

(1.23) 

dd 

(1.31) 

ad 

(1,50) 

2id 

(1.62) 

Greece 

la 

(1.73) 

fU 

(1.34) 

di 

(1.47) 

=3d 

(1.60) 

id 

(1.86) 

dd 

(2.14) 

iid 

(2.41) 

19.9 

(2,07) 

Hungary 


(1.57) 

Qd 

(1.35) 

8d 

(1.18) 

dd 

(1.72) 

2d 

(1.30) 

d_i 

(1.80) 

9d 

(1,66) 

22.8 

(1.25) 

Iceland 

m 

(1.46) 

£d 

(1.86) 

lid 

(1.47) 

LQ 

(1.54) 

2d 

(1.68) 

dd 

(1.68) 

24.4 

(1,88) 

2id 

(1.63) 

Ireland 


(1.42) 

id 

(1.43) 

lid 

(1.14) 

-7.0 

(2.24) 

Qd 

(1.32) 

dd 

(1,721 

lid 

(2,64) 

32.4 

(1.82) 

Italv 

4^ 

(1.02) 


(1.10) 

4J1 

(1.07) 

=ad 

(1.45) 

id 

(1.67) 

dd 

(1.74) 

lid 

(1.77) 

2id 

(1.33) 

Japan 

0.0 

(1.28) 

-0 6 

(1.38) 

hd 

(1.33) 

dd 

(1.83) 

Qd 

(1.57) 

4d 

(1.70) 

id 

(2.17) 

25.8 

(1.76) 

Korea 

lA 

(1.25) 

dL2 

(1.06) 

Md 

(1.65) 

id 

(1.87) 

2d 

(1.43) 

2d 

(1.71) 

ni 

(2,55) 

221 

(1.56) 

Luxembourg 

h.h 

(1.69) 

dU 

(1.34) 

9d 

(1.21) 

did 

(1.65) 

Qd 

(1.56) 

id 

(1.77) 

4J> 

(1.66) 

26d 

(1.31) 

Mexico 

u. 

(0.88) 

0.0 

(0,97) 

Id 

(1.49) 

-12.7 

(I.IS) 

Qd 

(1.82) 

dd 

(2.03) 

16.3 

(1,21) 

16.6 

(1.46) 

Netherlands 

id 

(1.24) 

dd 

(1.13) 

8d 

(1,28) 

dd 

(1.65) 

Qd 

(1.20) 

dd 

(1.71) 

10.6 

(1,72) 

12d 

(1.56) 

New Zealand 

11 

(1.27) 

2d 

(1.71) 

i2d 

(1.32) 

-11.1 

(1.92) 

4J1 

(1.44) 

=2d 

(Mil 

22A 

(2.41) 

ild 

(1.71) 

Norway 

SA 

(1.51) 

dd 

(2.36) 

14d 

(1.45) 


(1.65) 

6d 

(1.55) 

Id 

(2.01) 

21.9 

(2.13) 

22.9 

(1.74) 

Poland 

HU 

(1.77) 

id 

(1.96) 

11.8 

(1.18) 

-15.1 

(1.65) 

10.8 

(1.65) 

did 

(1.85) 

20.3 

(2,17) 

28.6 

(2.03) 

Portugal 

ad 

(1.57) 

dd 

(0.95) 

2d 

(1.80) 

dd 

(1.82) 

4d 

(1.74) 

=&A 

(2.35) 

18.4 

(1.72) 

2X2 

(1.97) 

Slovak Republic 

id 

(1.24) 

2d 

(1.50) 

14.8 

(1.54) 

=2d 

(1.37) 

4d 

(1.66) 

dd 


22d 

(2.22) 

24d 

(1.71) 

Spain 

id 

(1.14) 

Qd 

(0,98) 

16.0 

(1.26) 

dd 

(1.73) 

6d 

(1.60) 

dd 

(1.93) 

16.6 

(1,95) 

22d 

(1.26) 

Sweden 


(1.47) 

-1.0 

(1.54) 

lid 

(1.18) 

dd 

(1.61) 

4d 

(1.51) 

=A1 

(1.76) 

19.0 

(1.81) 

30.6 

(1.66) 

Switzerland 

ad 

(1.38) 

Id 

(1.10) 

Md 

(1.08) 

-5.5 

(1.36) 

dU 

(1.28) 

0,0 

(1.87) 

2d 

(1.77) 

30.4 

(2.41) 

Turkey 

2d 

(1.52) 

0 6 

(1.23) 

2d 

(1.48) 

JA 

(1.63) 

Id 

(1.75) 

dd 

(240) 

lid 

(1,83) 

19.0 

(1.45) 

United States 

ad 

(1.15) 

0.0 

(1.60) 

14.0 

(1.16) 

=1A 

(1.46) 

id 

(1.28) 

dd 

(1.33) 

lid 

(1,92) 

29.6 

(1.37) 

Partners 

















Brazil 

ad 

(2.07) 

=2d 

(1.11) 

6d 

(2.20) 

-13.2 

(2,72) 

Qd 

(1.95) 

=2d 

(2.54) 

13.8 

(2,22) 

16.4 

(2,00) 

Hong Kong-China 

id 

(1.69) 

dd 

(2,01) 

ad 

(1,36) 

dd 

(2.24) 

id 

(1.67j 

id 

(1.83) 

12.8 

(2,58) 

2Xi 

(1.82) 

Indonesia 

m 

m 

m 

m 

m 

m 

m 

m 

m 

m 

m 

m 

m 

m 

m 

m 

L atria 

2d 

(1.45) 

Qd 

(2.25) 

2d 

(1.51) 

-12.5 

(1.95) 

lo.n 

(1.58) 

AAl 

(2.52) 

2Ld 

(2.12) 

29d 

(2.21) 

Liechtenstein 

c 

c 

c 

c 

c 

c 

c 


c 

c 

c 

c 

c 

c 

c 

c 

Macao- China 

hd 

(3.91) 

did 

(2.85) 

id 

(3.16) 

dd 

(4.23) 

dd 

(4.25) 

Id 

(4.53) 

lid 

(4.07) 

2X1 

(4,04) 

Russian Fed. 

id 

(1.49) 

Id 

(2.20) 

hd 

(1.35) 

did 

(2.25) 

id 

(1.54) 

-6.8 

(2.36) 

1A2 

(2.40) 

2X4 

(2.25) 

Serbia 

id 

(1.14) 

-2.0 

(1.47) 

6.0 

(1.51) 

=2d 

(1.74) 

4d 

(1.58) 

=2d 

(1,86) 

12d 

(1.90) 

17.8 

(1.75) 

Thailand 

id 

(1.67) 

dU 

(1.36) 

id 

(1.43) 

dd 

(1.75) 

id 

(2.19) 

dd 

(2.52) 

IL2 

(2.09) 

12d 

(1.69) 

Tunisia 

fi.ft 

(1.52) 

=id 

(1.26) 

id 

(1.21) 

dd 

(1.34) 

id 

(1.48) 

dd 

(1.76) 

10-8 

(1,41) 

lid 

(1.36) 

Uruguay 

6d 

(1,59) 

did 

(1,54) 

id 

(1.46) 

All 

(1,99) 

2d 

(1.41) 

All 

(2.42) 

Md 

(2,35) 

1X2 

(1.51) 

United Kingdom’ 

9d 

(1,27) 

idi 

(1.57) 

11.0 

(1.19) 

dd 

(1.84) 

2d 

11.54) 

=2d 

(1.73) 

lid 

(2.26) 

i2d 

(1.49) 


1_ Response rate too low to ensure comparabilitv. 
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Table C.l 

Multivariate regression coefficients and standard errors (continued) 


Score point difference associated with the various factors shown below, before accounting for the other factors 


Time students invest in learning 


Out-of-school learning time 


Learning strategies and preferences in mathematics 


Learning strategit 


Students’ preference 
for learning situations 



Attending 

out-of- 

school 

classes 

Hours per 
vyeek of 
homework 
in total 

Hours per 
week of 
mathematics 
homework 

Working 
with 
a tutor 

Control 

strategies 

Elaboration 

strategies 

Memo- 

risation/ 

rehearsal 

strategies 

Competithe 

learning 

situations 

Co-operative 

learning 

situations 


Coeff 

S.E. 

Coeff 

S.E. 

Coeff 

S.E. 

Coeff 

S.E. 

Coeff 

S.E. 

Coeff 

S.E. 

Coeff 

S.E. 

Coeff 

S.E. 

Coeff 

S.E. 

OECD 



















Australia 


(1.57) 

6-1 

(1.53) 

=L9 

(1.28) 

=2-5 

(0.01) 

4-1 

(1.17) 

-15.9 (1.20) 

=5-1 

(1.32) 

1-1 

(1.60) 

=13 

(1.13) 

Aiistri.i 

dlL2 

(3.B) 

IS 

(3.01) 

=5-1 

(2.57) 

=4-5 

(1.12) 

=0-2 

(1.16) 

=0-6 

(1.06) 

=8-1 

(1.05) 

1-2 

(1.05) 

0-2 

(0.84) 

Belgium 


(1.57) 

lA 

n,59i 

=4-4 

(Um 

=4-6 

[Lill 

=2-2 

ll.OS) 

Ail 

(1.37) 

=1-9 

(1.17) 

-3.0 

(1.15) 

-LO 

(1.11) 

Canada 

=L1 

(1.26) 

6-6 

(1.04) 

=1-9 

(0.90) 

=4-2 

(0.81) 

4-1 

(1.14) 

=8-1 

(1.00) 

=4-1 

(1.08) 

-2.0 

(0,86) 

-1.0 

(0.89) 

Czech Republic 

-2.0 

(1.62) 

1-8 

(1.83) 

JS 

(1.74) 

-5.0 

(1.23) 

=2-8 

(1.41) 

All 

(1.40) 

=6/Z 

(1.27) 

1-4 

(1.24) 

=£L4 

(1.05) 

Denmark 

=1A 

(2,09) 

QS 

(2,89) 

=6-4 

(2.08) 

=2-5 

(3.23) 

=5-5 

(1.83) 

ALL 

(2.19) 

=4-2 

(1.63) 

4-8 

(1.92) 

=3-i 

0.56) 


-1?,8 

(4,09) 

1-9 

(2.911 

-18.S 

(7.43) 

-i?.n 

(3.33) 

=0-5 

(1.50) 

=6-2 

(1.30) 

=4-8 

(1.27) 

=0-1 

(1.32) 

3-1 

0-36) 

France 

w 

w 


w 

w 

w 

w 

w 

w 

w 

w 

w 

w 

w 

Germany 

=9^ 

(1.88) 

m 

(2.01) 

=6-1 

(1.77) 

=1-5 

(0.01) 

=11 

(1.40) 

All 

(1.02) 

=6-9 

(1.12) 

=0-1 

(1.13) 

1-L 

(1.09) 

Greece 

=2A 

(MU 

L& 

(1.08) 

=iLl 

(1.21) 

=5-6 

(0.94) 

0.0 

(1.67) 

=5-8 

(1.67) 

=2-3 

(1.03) 

2-4 

(1.78) 

=0-6 

(1.31) 

Hungary 

=1A 

(1.00) 

AS 

(1.11) 

=4-5 

(1.20) 

=4-1 

(1.26) 

SA 

(1.57) 

=2-1 

(1.14) 

=5-1 

(1.20) 

=0-9 

(1.28) 

IS 

(1.54) 

Iceland 


(1.62) 

9-9 

(2,98) 

-10.8 

(2.32) 

=6-8 

(1.29) 

AA 

(1,50) 

-10.3 

(1.83) 

-5.0 

(1.64) 

=0-1 

(1.57) 

=3-6 

(1.34) 

Ireland 


11. SO) 

9-1 

(1.32) 

=5-1 

(1.61) 

=2-5 

(1,27] 

AS 

(1.49) 

=9-6 


AS 

(1.74) 

=0-1 

(1.40) 

0.0 

(1.54) 

Italy 

=5-9 

(1.61) 

£Li 

(0.92) 

=1-1 

(1.13) 

=5-8 

(0,82) 

0-2 

(1.33) 

=3-2 

(1.20) 

=6-1 

(1.35) 

=U. 

(1.26) 

=0-6 

(1.02) 

japan 

-3.0 

(1 ,07j 

8-1 

(2.68) 

AlA 

LLZi) 

-8.8 

(1.44) 

=2-1 

(1.28) 

=2-6 

(1.34) 

=LS 

(1.38) 

=0-6 

(1.17) 

4.0 

(1.11) 

Korea 


(0,66) 

11.S 

(2.75) 

AS 

(2,79) 

=1-1 

(0.89) 

4-4 

(1.84) 

=1-9 

(1.47) 

=9-5 

(1.63) 

2J1 

(1.57) 

OS 

(1.52) 

Luxembourg 


(1.04) 

66Z 

(2.18) 

=9J 

(1.75) 

=2-2 

(1.24) 

AS 

(1.40) 

=8-6 

(1.34) 

=2-5 

(1.27) 

0.0 

(1.20) 

=0-9 

(0.07) 

Mexico 

AS 

(3.85) 

2-8 

(1.57) 

All 

(1.26) 

=1-1 

(4.59) 

All 

(1.16) 

=1-2 

(L43) 

=4-8 

(1.06) 

2-0 

(1.68) 

-3.0 

(1.04) 

Netherlands 

m 

m 

2J. 

(1.40) 

-6.6 

(1.78) 

=5-4 

(1.23) 

=5-2 

(1.20) 

AS 

(1.46) 

2-0 

(1.25) 

=2-6 

(1.62) 

1-9 

(1.25) 

New Zealand 

-10.6 

(1.65) 

12-1 

(2.16) 

=8-6 

(1.07) 

=6-5 

(1.79) 

5-1 

(1.60) 

-16.6 

(1.80) 

-4.0 

(1.56) 

=5-1 

(1.60) 

=3-6 

(1.42) 

Norway 

-5.0 

(2.36) 

9-4 

(2.43) 

-12.6 

(2,70) 

=li2 

(2.43) 

0-1 

(1.71) 

-12.0 

(1.70) 

0-5 

(1.75) 

=2-5 

(1.47) 

IS 

(1.20) 

Poland 


(1.00) 

10.4 

(1.33) 

=8-1 

(0.06) 

=4-1 

(0.90) 

J_6 

(1.58) 

=6-5 

(1.75) 

=4-8 

(1.58) 

l-I 

(1.50) 

A2 

(1.31) 

Portugal 

-3.0 

(1.11) 

1-8 

(2.18) 

=5-8 

(2.09) 

=1S 

(0.84) 

4-8 

(1.65) 

=6-4 

(1.85) 

-6.0 

(1.60) 

-2,0 

(1.41) 

Hi 

(1.60) 

Slovak Republic 

-3.0 

(1.10) 

lU 

(1.34) 

=1-6 

(1.05) 

=1-1 

(1.12) 

=1.4 

(1.39) 

AS 

(1.80) 

=5-8 

(1.33) 

lA 

(1.22) 

AS 

(1.24) 

Spain 

=2-1 

(0,86) 

10.7 

(1,92) 

=5-9 

(1.83) 

=1-5 

(0,86) 

1-7 

(1.40) 

=4-1 

(1,28) 

AA 

(1.27) 

0-5 

(1.18) 

(11 

(1.35) 

Sweden 

SA 

(3.16) 

4-9 

(2.45) 

-18.4 

(2.44) 

=12J 

(1.84) 

=8-4 

(1.41) 

-6.0 

(1.67) 

QA 

(1.47) 

1-2 

(1.55) 

1-4 

(1.20) 

Switzerland 

AAl 

(2.27) 

6-1 

(2.07) 

-14.6 

(2.48) 

-5.0 

(1.62) 

01 

(1.18) 

=6-9 

(1.53) 

-7.0 

(1.02) 

-4.0 

(1.89) 

2-2 

(1.09) 

Turkey 

=2-1 

(1.23) 

1-4 

(2.05) 

=82 

(1.87) 

=4-5 

(1.78) 

1-9 

(1.01) 

-8.0 

(1.52) 

=1-2 

(1.75) 

1-9 

(1.72) 

All 

(1.52) 

United States 

=2.9 

(2.10) 

9-2 

(2.03) 

=1-1 

(1.21) 

=6-1 

(1.20) 

HI 

(1.52) 

-9.0 

(1.60) 

=5-1 

(1.46) 

0-9 

(1.44) 

=2-4 

(1.11) 

Partners 



















Brazil 

=A-2 

(1,34) 

8-8 

(2,09) 

=5-5 

(1,89) 

=9-5 

(1.49) 

11 

(1.07) 

=ia 

(2.00) 

AA 

(2.29) 

=1-5 

(1.74) 

0-5 

(2.151 

Hong Kong- China 

AS 

(0,90) 

9-9 

(1.01) 

=2-8 

(1.60) 

-4.0 

(0.89) 

5-6 

(1.20) 

AS 

(1.07) 

=8-6 

(1.56) 

=6-9 

(1.62) 

1-4 

(1.60) 

Indonesia 

m 

m 

m 

m 

m 

m 

m 

m 

m 

m 

m 

m 

m 

m 

m 

m 

m 

m 

Latvia 

AS 

(1.41) 

1-6 

(1.34) 

-4.0 

(1.67) 

=1-8 

(0.05) 

=7-8 

(2.32) 

AS 

(2.85) 

=1.6 

(2.28) 

£L4 

(2.46) 

=1-5 

(1.00) 

Liechtenstein 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

C 

Macao-China 

-3.0 

(2.10) 

6-1 

(4.29) 

iA 

(3.28) 

-ll.O 

(2.47) 

41 

(3.80) 

AA 

(3.75) 

-10.4 

(3.81) 

(14 

(4.41) 

AS 

(3.56) 

Russian Fed. 

AS 

(0.971 

262 

(0.87) 

AS 

(0.72) 

=5-2 

(1.05) 

=61 

(1.74) 

=6-2 

(2.05) 

=4-5 

(1.64) 

IS 

(1.97) 

0,0 

(1.53) 

Serbia 

=A-2 

(1.78) 

l-Q 

(1.65) 

(L2 

(1.56) 

=2-5 

(0.07) 

Hi 

(1.28) 

=2-1 

(1.72) 

=8-1 

(1.62) 

All 

(1.64) 

=0-1 

(1.27) 

Thailand 

AIS 

(0,82) 

li.n 

(1.621 

0-5 

(1.18) 

=1-9 

(0.94) 

3-6 

(2,03) 

AS 

(1.99) 

=9-9 

(2.57) 

=0-1 

(2,181 

=L6 

(2.13) 

Tunisia 

=1A 

(0.S2) 

[IS 

(1.00) 

1-5 

(1.50) 

m 

m 

1-1 

(1.32) 

0J_ 

(1.46) 

0-2 

(1.18) 

1-2 

(1,63) 

=3-2 

(i.iii 

Uruguay 

ss 

(1.51) 

IS 

(1,88) 

_LI 

(1.59) 

=5-6 

(1.48) 

=4-2 

(1,85) 

=L2 

(2.31) 

=0-6 

(1.55) 

_Z-9 

(1.62) 

All 

(1.341 

United Kingdom 

-1.0 

(1,30) 

14.0 

(1.70) 

-10.3 

(1.54) 

=5-9 

(1.23) 

0-1 

(1.96) 

=15-1 

(1.62) 

-1.0 

(1.56) 

-3.0 

(1.57) 

AA 

(1.14) 


L. Response rate too low to ensure comparability. 
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Table C.2 

Bivariate regression coefficients and standard errors 


Score point difference associated with the various factors shown below, before accounting for the other factors 


School characteristics 



School average 
of the highest 
international 
socio- 
economic index 
of occupational 
status (HISEI) 
between both 
parents 

School size 

School climate 

Classroom climate 

Attitudes 

towards 

school 

Sense of 
belonging at 
school 

Student- 

teacher 

relations 

Disciplinary 

climate 

School aver- 
age discipli- 
nary climate 

Teacher 

support 


Coeff, 

S.E. 

Coeff. 

S.E. 

Coeff. 

S.E. 

Coeff. 

S.E. 

Coeff, 

S.E, 

Coeff, 

S.E. 

Coeff, 

S.E. 

Coeff, 

S.E. 

OECD 

















Australia 


(3.37) 

24*9 

(1.34) 

10*2 

(1.10) 

as 

(1.19) 

15*4 

(1.02) 

J6*0 

(0,89) 

29*5 

(0.59) 

3*4 

(1.24) 

Austria 

ilA 

(1.28) 

15.7 

(5.19) 

=2*2 

(1.00) 

OJ. 

(0.95) 

Od 

(1.29) 

6*9 

(1.31) 

24*2 

(1.97) 

dL9 

(1.46) 

Belgium 

5T0 

(2.46) 

29.3 

(6.08) 


(1.10) 

-0.8 

(1.31) 

AA 

(1.11) 

10.8 

(0,90) 

50*9 

(3.48) 

=2.2 

(0,92) 

Canada 

21A 

(0,78) 

11*4 

(1.43) 

fi.ft 

(Q.87) 

AA 

(0.89) 

9*5 

(1.05) 

Md 

(0.93) 

14*0 

(0.97) 

6d 

(1.02) 

Czech Republic 

ii9 

(4.60) 

0*6 

(9.01) 

1*1 

(1.33) 

3*0 

(1.72) 

d*4 

(1.27) 

6*2 

(1.05) 

10*6 

(2.26) 

d*6 

(1.44) 

Denmark 

2±1 

(1.85) 

11*0 

(6.47) 

5*2 

(1.64) 

-LI 

(1.69) 

0*0 

(1.65) 

6*0 

(1.97) 

15*9 

(1.60) 

6*6 

(2.00) 

Finland 


(0,99) 

22A 

(2,84) 

12*1 

(1,46) 

AS 

(1.23) 

0*2 

(1,37) 

lOd 

(1.42) 

5*4 

(1.29) 

4.9 

(1,78) 

France 

w 

w 

w 

w 

w 

w 

w 

w 

w 

w 

w 

w 

w 

w 

w 

w 

Germany 

iIL6 

(3.37) 

0*2 

(4.25) 

=1*0 

(1.25) 

=5*4 

(1.36) 

0.4 

(1.06) 

3*5 

(1.16) 

25*3 

(2.40) 

11*5 

(1.13) 

Greece 

40.2 

(1.07) 


(16,24) 


(1.53) 

IS 

(1.44) 

AO 

(1.69) 

id 

(1.56) 

24*6 

(2.60) 

Od 

(1.70) 

Hungary 

56*2 

(1.28) 

2^4 

(11,44) 

=3*1 

(1.36) 

IS 

(1.19) 

AS 

(1.19) 

5*1 

(1.11) 

10*0 

(1.60) 

0.0 

(1.21) 

Iceland 

Sxfl 

(1.87) 

5*1 

(4.93) 

15*0 

(1.46) 

0*1 

(1.45) 

no 

(1.43) 

11*1 

(1.76) 

6*3 

(1.80) 

9.3 

(1.87) 

Ireland 

M*6 

LLMI 

13*1 

(5.15) 

6*1 

(1.46) 

=4*3 

(1.42) 

4*5 

(1.70) 

15*0 

(1,52) 

5*3 

(0.92) 

AO 

(1.67) 

Italy 

49*1 

(0,68) 

11*5 

(5.59) 

0*6 

(1.08) 

dL5 

(1.15) 

=5d 

(1.06) 

4*6 

(1.12) 

22*5 

(0.49) 

=2*6 

(1.07) 

Japan 

77.« 

(0.83) 

25*1 

(1.03) 

=0*0 

(1.43) 

-1 .0 

(1.50) 

5*0 

(1.52) 

5d 

(1.84) 

42d 

(0,89) 

LI 

(1.77) 

Korea 

iSd 

(1.08) 

20*0 

(4.64) 

1*2 

(1.16) 

1*0 

(1.31) 

6*2 

(1.22) 

lO 

(1.38) 

53d 

(3.69) 

IS 

(1.42) 

Luxembourg 

51*5 

(1.16) 

4*5 

(1.12) 

=2*5 

(1.33) 

4*4 

(1.33) 

Qd 

(1.33) 

lA 

(1.23) 

60*5 

(2.32) 

=2*8 

(1.13) 

Mexico 

25*9 

(0.32) 

5*1 

(1.87) 

10.5 

(1.11) 

5*3 

(0.94) 

=5d 

(1.29) 

10*5 

(1.32) 

25*0 

(0.98) 

Qd 

(1.02) 

Netherlands 

52*1 

(3,46) 

10*5 

(2.84) 

=1*1 

(1.43) 

AS 

(1.47) 

5d 

(1.83) 

4d 

(1.68) 

-19*5 

(7.38) 

LQ 

(1.33) 

New Zealand 

16*fi 

(1.76) 

15*2 

(0,94) 

11*4 

(1.53) 

2*5 

(1.38) 

15*4 

(1.72) 

14*3 

(1.61) 

20*3 

(1.38) 

4*4 

(1.40) 

Norway 

19*2 

(1.71) 

0*0 

(7.99) 

15*0 

(1.86) 

ALl 

(1.53) 

16.1 

(1.61) 

1L4 

(1.84) 

Hd 

(1.62) 

JULI 

(1.90) 

Poland 

29*3 

(1.36) 

10*1 

(2,70) 

=0*0 

(1.72) 

3*5 

(1.35) 

=3d 

(1.80) 

55*0 

11.38) 

5d 

(L55) 

-0 8 

(1.58) 

Portugal 

15*5 

(0,98) 

20*2 

(3.85) 

6.6 

(1.31) 

in .1 

(1.50) 

dL5 

(1.42) 

15*2 

(1.64) 

56*5 

(1.03) 

dL9 

(1.75) 

Slovak Republic 

46*3 

(0.63) 

14*1 

(7.64) 

=6*4 

(1.35) 

0*2 

(1.30) 

=9*6 

(1.42) 

5d 

(1.34) 

19*5 

(0.75) 

=6*8 

(1.13) 

Spain 

26*4 

(0.59) 

9*6 

(4.11) 

5*1 

(1.28) 

0*4 

(1.37) 

Id 

(1.30) 

15*1 

(1.34) 

15*0 

(0,80) 

-0.8 

(1.46) 

Sweden 

25*D 

(1.62) 


(3.30) 

11*0 

(1.46) 

dU 

(1.53) 

14*0 

(1.37) 

15*2 

(1.81) 

15d 

(2.00) 

Id 

(1.84) 

Switzerland 

19*5 

(0.90) 

IILL 

(5.15) 

1*4 

(1.90) 

5*0 

(1.29) 

0.0 

(1.81) 

11.0 

(2.13) 

19*0 

(1.00) 

J_6 

(1.88) 

Turkey 

50.0 

(0,94) 

Id 

(346) 

-1.0 

1L32J 

9*6 

1L65 

AA 

(1.46) 

ns 

[1711 

45*5 

1X501 

IS 

(1.40) 

United States 

41*1 


1*1 

(2.27) 

6.6 

(U31 

m 

m 

10*0 

(1.41) 

20*6 

(1.23) 

213 

(0.95) 

6*3 

(1.31) 

Partners 

















Brazil 

40*2 

(1.74) 

10. 

(2.19) 

1*3 

(1.40) 

5d 

(1.12) 

AS 

(1.34) 

10.4 

(1.90) 

55d 

(3.97) 

=5*8 

(1.42) 

Hong Kong-China 

40*3 

(1,24) 

116.4 

(7.65) 

6*1 

(i.'^O) 

5*5 

(1.62) 

6*7 

(1.41) 

10.7 

(1,33) 

73*2 

(1,28) 

&A 

n.63) 

Indonesia 

m 

m 

m 

m 

m 

m 

m 

m 

m 

m 

m 

m 

m 

m 

m 

m 

Latvia 

26*6 

(1.37) 

10*1 

(2.65) 

OIZ 

(1.94) 

9d 

(2.10) 

0*0 

(2.05) 

15*2 

(2.48) 

3.0 

(0,92) 

Qd 

(2.11) 

Liechtenstein 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

Macao- China 

21*0 

(3.52) 

4*5 

(2.82) 

1*2 

(5.68) 

4*5 

(5.21) 

4*0 

(3.81) 

15*4 

(4.12) 

45*0 

(3.93) 

d*6 

(4.41) 

Russian Fed. 

10*4 

(1.18) 

I4*S 

(4.91) 

1*6 

(1.38) 

11 

(1.00) 

=4*2 

(1.35) 

14*3 

(1.56) 

13*5 

(1.12) 

1*5 

(1.46) 

Serbia 

41*2 

(0,66) 

0*0 

(1.52) 

=0*0 

(1,32) 

0*2 

(1.02) 

- 11.8 

(1.3S) 

10 .^ 

(1,52) 

55*3 

(0.681 

=8*2 

(1,22) 

Thailand 

16*4 

(0.82) 

11*9 

(0.29) 

■Lh 

(1.31) 

6.9 

(1.42) 

=4*0 

(1.34) 

19*2 

(1.50) 

lAd 

(1.06) 

Sd 

(1.28) 

Tunisia 

11*9 

(0.32) 

12*6 

(4.48) 

4*0 

(0.87) 

5*6 

(0.93) 

=4d 

(0.85) 

3*1 

(1.23) 

20d 

(0.66) 

dLI 

(1.17) 

Uruguay 

44.4 

(0,76) 

40 n 

(1.61) 

2*1 

(1.61) 

2J 

(1.26) 

=6*3 

(1.27) 

7A 

(1,82) 

51*9 

(1.07) 

=4.8 

(1.55) 

United Kingdom 

13J 

(2,87) 

11.0 

(4,71) 

9*0 

(1.23) 

0*1 

(1.21) 

14*2 

(1.46) 

20*0 

(1.10) 

22*6 

(1.76) 

3.4 

(1.31) 


J_ Response rate too low to ensure comparability. 
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Annex C. Bivgi-Ute gn4 Multilevel 


Table C.2 

Bivariate regression coefficients and standard errors fcontinueJ^ 


Score point difference associated with the various factors shown below, before accounting for the other factors 

Student characteristics 




Home background 




Self- 

related 

cognitions in mathematics 




The highest 
international 
socio-economic 
index of occu- 
pational status 
(HlSEl) between 
both parents 

The highest 
level of 
education 
between 
both parents 

(HISCED) 

Number of 
books 
in the home 

Anxiety 

in 

mathematics 

Instrumental 

motivation 

in 

mathematics 

Interest in 
and 

enjoyment of 
mathematics 

Self-concept 

in 

mathematics 

Self-efficacv in 
mathematics 


Coeff, 

S.E. 

Coeff 

S.E. 

Coeff 

S.E. 

Coeff 

S.E. 

Coeff 

S.E. 

Coeff 

S.E. 

Coeff 

S.E. 

Coeff 

S.E. 

OECD 

















Australia 

19S 

(1.30) 

12A 

(1.49) 

lid 

(0.95) 

-34.2 

(US) 

lid 

(0.94) 

ns 

(1.07) 

i3d 

(1.10) 

43.4 

(0.88) 

Austria 


(1.21) 

IS 

(1.68) 

12d 

(1.28) 

-20.9 

(1.03) 

id 

(1.15) 

10.2 

(1.22) 

23.1; 

(1.12) 

27.8 

(1.18) 

Belgium 

17J. 

(1.13) 

II.O 

(1.25) 

16.8 

(1.12) 

-23.0 

(1.09) 

11.6 

(1.20) 

15.1 

(1.18) 

24d 

(1.19) 

33.0 

(1.50) 

Canada 

1S-1 

(1.06) 

i&s 

(L47] 

2QS 

(0.98) 

-30.6 

(0.79) 

19.0 

(0.86) 

19.9 

(0.94) 

Md 

(0.66) 

i3d 

(0.83) 

Czech Republic 

ILd 

(l.SI) 

ITS 

(2.09) 

19.S 

(1.63) 

-32.0 

(1.35) 

J4d 

(1.38) 

18.4 

(1.52) 

32.8 

(1.27) 

38.3 

(1.19) 

Denmark 

21A 

(1.73) 

2TS 

(2.02) 

27.6 

(1.77) 

-42.8 

(1.40) 

21 0 

(1.48) 

28.1 

(1.56) 

4id 

(1.28) 

A&S 

(1.78) 

Finland 

21^ 

(1.28) 

ISA 

(1.52) 

28.6 

(1.47) 

ms 

(1.51) 

26.6 

(1.71) 

30.2 

(1,61) 

44.9 

(1.19) 

4id 

(1,40) 

France 

w 

w 

w 

w 

w 

w 

w 

w 

w 

w 

w 

w 

w 

w 

w 

w 

Germany 

ITO 

(1.52) 

lid 

(1.34) 

17.8 

(1.17) 

-22.2 

(0.87) 

SI 

(1.29) 

Md 

(1.09) 

lid 

(0,97) 

32.6 

(1.23) 

Greece 

1L2 

(1.66) 

10.8 

(1.45) 

17.0 

(1.31) 

-28.6 

(1.42) 

ns 

(1.33) 

19.8 

(1.30) 

Md 

(1.56) 

lid 

(1.93) 

Hungary 

lOJ. 

(1.62) 

lid 

(1.66) 

ns 

(1.24) 

-23.6 

(1.23) 

8d 

(1.34) 

in.8 

(1.52) 

lid 

(1.25) 

29.9 

(1.21) 

Iceland 

1L9 

(1.50) 

2Qd 

(1.79) 

2AS 

(1.73) 

did 

(1.34) 

18.0 

(1.68) 

2AS 

(1.45) 

3Sh 

(1.14) 

40d 

(1.27) 

Ireland 


(1.73) 

IS.9 

(1.59) 

2AS 

(1.48) 

-30.0 

(1.53) 

fid 

(1.40) 

lid 

(1.52) 

ild 

(1.55) 

44.n 

(1.35) 

Italy 

7A 

(1.11) 

id 

(1.11) 

in.7 

(1.18) 

-23.3 

(1.29) 


(1.29) 

lAA 

(1.15) 

23.6 

(1.06) 

Md 

(1.38) 

Japan 

IM 

(1.47) 

ixi 

(1.64) 

10.8 

(1.26) 

-14.4 

(1.18) 

lid 

(1.15) 

lid 

(1.11) 

18.2 

(1.10) 

30.4 

(1.34) 

Korea 

■LI 

(1.52) 

hS 

(1.20) 

24.0 

(1.55) 

-18.3 

(1.38) 

19.0 

(1.15) 

ns 

(1.03) 

ild 

(1.26) 

35.6 

(1.36) 

Luxembourg 

ILd 

(1.42) 

&S 

(1.08) 

16. ■; 

(1.30) 

-20.8 

(1.17) 

4S 

(1.17) 

S& 

(1.18) 

13d 

(1.14) 

31.8 

(1.18) 

Mexico 

4^ 

(0.76) 

IS 

(0.99) 

id 

(1.57) 

-26.0 

(1.19) 

id 

(1.32) 

IS 

(1.52) 

ns 

(0.99) 

20.1 

(1.27) 

Netherlands 


(1.3S) 

AS 

(1.21) 

ns 

(1.34) 

-20.4 

11.43) 

10.5 

(1.29) 

lid 

(1.47) 

lid 

(1.44) 

lid 

(1.25) 

New Zealand 

lid 

(1.44) 

2n.9 

(1.93) 

79.0 

(1.57) 

-44.4 

(1.35) 

16.3 

(1.72) 

lid 

(1.62) 

44.2 

(1.32) 

48.8 

(1.36) 

Norway 

2&A 

(1.75) 

ns 

(2.30) 

29.7 

(1.66) 

ms 

(1.33) 

27.9 

(1.55) 

34.0 

(1.36) 

4id 

(1.23) 

46d 

(1.52) 

Poland 

ild 

11.74) 

ns 

(2.36) 

1L2 

(1.47) 

-44.8 

(1.34) 

18.8 

(1,63) 

ns 

(1.37) 

44.8 

(1,39) 

50.7 

(1.93) 

Portugal 

22J} 

(1.40) 

10.4 

(1.10) 

24.9 

(1.53) 

ms 

(1.40) 

lid 

(1.59) 

15.6 

(1.75) 

30.9 

(1.18) 

AiS 

(1.88) 

Slovak Republic 

IAS 

(1.25) 

IS.2 

(2.16) 

26.4 

(1.89) 

-37.0 

(1.03) 

11.8 

(1.36) 

lid 

(1.67) 

39.9 

(1.44) 

iSA 

(1.49) 

Spain 

ILS 

(1.25) 

10-2 

(0.86) 

28.8 

(1.36) 

-22.6 

(1.74) 

iSl 

(1.04) 

20.6 

(1.24) 

ifid 

(1.13) 

36.5 

(1.38) 

Sweden 

ns 

(1.77) 

ns 

(1.75) 

34.4 

(1.51) 

-41.2 

(1.56) 

77.9 

(1.83) 

27.7 

(1.63) 

46.2 

(1.56) 

51.8 

(1.61) 

Switzerland 

i&s 

(1.54) 

13.6 

(1.34) 

lid 

(1.21) 

-26d 

(1.04) 

fid 

(1.54) 

Md 

(1.36) 

lid 

(1.15) 

40.0 

(1.47) 

Turkey 


(1.60) 

6d 

(1.39) 

lid 

1170] 

SSI 

(1.52) 

Si 

(1.47) 

ns 

(1,64) 

lid 

(1.56) 

24.8 

(1.59) 

United States 

22S 

(1.26) 

2fi.n 

(1.90) 

28.4 

(1.18) 

-30.1 

(1.17) 

16.8 

(1.23) 

12.9 

(1.18) 

32.2 

(1.19) 

41.4 

(1.17) 

Partners 

















Brazil 

lid 

(2.26) 

Qd 

(1.20) 

12.0 

(2.27) 

-27.4 

(2.24) 

Qd 

(1.72) 

id 

(2,07) 

lid 

(1.57) 

19.8 

(1.84) 

Hong Kong-China 

IS 

(1.76) 

SJ 

(2.01) 

12.9 

(1.42) 

-20.3 

(1.72) 

lid 

(1,50) 

22.0 

(1.25) 

lid 

(1.56) 

34.8 

(1.61) 

Indonesia 

m 

m 

m 

m 

m 

m 

m 

m 

m 

m 

m 

m 

m 

m 

m 

m 

Latvia 

1L6 

(1.82) 

1S.9 

(3.95) 

lid 

(2.16) 

-42.1 

(1.99) 

19.2 

(1.61) 

16. ■; 

(2.43) 

41.8 

(1.93) 

47.0 

(2.61) 

Liechtenstein 

c 

c 

c 

c 

c 

c 

c 


c 

c 

c 

c 

c 

c 

c 

c 

Macao- China 

iid 

(4.10) 

2d 

(3.23) 

Id 

(3.70) 

-26.4 

(3.71) 

AS 

(3.77) 

13d 

(4.18) 

30.6 

(3.67) 

38.2 

(3.70) 

Russian Fed. 

ns 

(1.51) 

ns 

(1.92) 

18.6 

(1.40) 

did 

(1.68) 

m.i 

(1.54) 

ILi 

(1.70) 

Md 

(1.63) 

38.0 

(1.97) 

Serbia 

lid 

(l,4i) 

2d 

(1.50) 

lid 

(1.76) 

-23.6 

(1,23) 

2d 

(1.32) 

Id 

(1,57) 

lid 

(1,48) 

22.0 

(1.83) 

Thailand 

2d 

(1.37) 

id 

(1.21) 

&d 

(1.66) 

-14.9 

(1.58) 

9d 

(1.67) 

6d 

(1.79) 

16.9 

(1.71) 

23.6 

(1.73) 

Tunisia 

IILS 

(1.37) 

AS 

(1.06) 

ns 

(1.44) 

-lO.O 

(1.33) 

3d 

(1.18) 

id 

(1.17) 

lid 

(0.96) 

18.2 

(1.32) 

Uruguay 

n.n 

(1.36) 

IS 

(1.47) 

ns 

(1.86) 

-28.2 

(1,7!) 

in.o 

(1.31) 

lid 

(1.62) 

lid 

(1.40) 

28.5 

(1.60) 

United Kingdom’ 

2LS 

(1.38) 

A&S 

(1.77) 

26.0 

(1.37) 

-29.9 

(1.20) 

11.6 

(1,45) 

13.8 

(1.30) 

Md 

(1,43) 

44.4 

(1.29) 


- Response rate too low to ensure comparabilitv. 
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Table C.2 

Bivariate regression coefficients and standard errors fcontinued^ 


Score point difference associated with the various factors shown below, before accounting for the other factors 


Time students invest in learning 


Learning strategies and preferences in mathematics 


Out-of-school learning time 


Learning strategies 


Students’ preference 
for learning situations 


Attending 

out-ot- 

school 

classes 

Hours per 
week of 
homework 
in total 

Hours per 
week of 
mathematics 
homework 

Working 
with 
a tutor 

Control 

strategies 

Elaboration 

strategies 

Memo- 

risation/ 

rehearsal 

strategies 

Competiti\e 

learning 

situations 

Co-operative 

learning 

situations 

Coeff 

S.E. 

Coeff 

S.E. 

Coeff 

S,E. 

Coeff 

S.E, 

Coeff 

S.E. 

Coeff 

S.E. 

Coeff 

S.E. 

Coeff 

S.E. 

Coeff 

S.E. 

OECD 


















Australia -9.2 

(1.89) 

14.7 

(1.38) 

8.3 

(1.42) 

-6.5 

(1.03) 

12.4 

(1.27) 

0.0 

(0.99) 

7.9 

(1.17) 

12.5 

(1.26) 

-2,5 

(1.30) 

Austria -13.4 

(3.24) 

-6.9 

(2.23) 

-15.8 

(2.35) 

-13.8 

(1.28) 

-3.6 

(1.06) 

3.1 

(1.08) 

-11.3 

(0.97) 

0.5 

(1.03) 

-2.2 

(1.09) 

Belgium -10.6 

(1.63) 

5.5 

(1.48) 

-2,3 

(1.42) 

-11.0 

(1.63) 

-2.4 

(1.19) 

1.2 

(1,36) 

-6.7 

(1,35) 

-0.3 

(1.18) 

-4.3 

(1,27) 

Canada -7.3 

(1.68) 

9.4 

(1.20) 

1,2 

(1.00) 

-11.5 

(0.87) 

11.5 

(1.05) 

7.5 

(1.01) 

6.5 

(0.97) 

12.1 

(0.93) 

-5.0 

(1.01) 

Czech Republic -5.5 

(1.97) 

-2.3 

(1.80) 

-11.9 

(1.72) 

-9.3 

(1.22) 

-0.9 

(1.67) 

12.6 

(1.37) 

-5.7 

(1.52) 

12.5 

(1.34) 

-5.6 

(1.23) 

Denmark -12.7 

(2.45) 

-2,9 

(2.83) 

-10.3 

(1.89) 

-18.7 

(3.62) 

4.4 

(2.17) 

10.7 

(2.00) 

9.5 

(1.80) 

22.3 

(1.65) 

-4.0 

(1.72) 

Finland -13.8 

(5.35) 

-4,2 

(2.44) 

-18.5 

(2.37) 

-22.0 

(3.84) 

11.4 

(1.36) 

16.8 

(1.34) 

6.6 

(1.48) 

19.7 

(1,34) 

3,0 

(1,66) 

France w 

w 

w 

w 

w 

w 

w 

w 

w 

w 

w 

w 

w 

w 

w 

w 

w 

w 

Germany -13.5 

(2.67) 

-4.5 

(1.76) 

-12.1 

(1.49) 

-12.2 

(0.85) 

-5.9 

(1.23) 

4.6 

(1,26) 

-9.1 

(1.16) 

5.9 

(1,22) 

0.7 

(1.09) 

Greece -0.3 

(0.71) 

9.0 

(1.29) 

5.3 

(1.24) 

-6.0 

(1.04) 

3.0 

(1.41) 

8.4 

(1.32) 

•1,7 

(1.91) 

11.8 

(1.41) 

0.5 

(1.23) 

Hungary -6.7 

(0.73) 

0.4 

(0.94) 

-6.1 

(1.15) 

-9.2 

(0.97) 

-4.7 

(1.33) 

3.1 

(1.16) 

-6.2 

(0.94) 

6.7 

(1.30) 

0.6 

(1.43) 

Iceland -10.1 

(2.26) 

8.5 

(2.81) 

-8.4 

(2,28) 

-16.4 

(1.55) 

4.4 

(1.62) 

0.4 

(1.58) 

-0.5 

(1.47) 

14.0 

(1.69) 

-1.4 

(1.43) 

Ireland -1.0 

(1.92) 

14.9 

(1.38) 

3,0 

(1.64) 

-10.4 

(1.42) 

3.7 

(1.48) 

-0.5 

(1,73) 

4.7 

(1.65) 

5.6 

(1.79) 

-2,9 

(1.73) 

Italy -9.3 

(1.90) 

0.5 

(0.77) 

-2.7 

(1.22) 

-10.5 

(1.02) 

2.0 

(1.30) 

5.7 

(1.21) 

-5.5 

(1.23) 

5.7 

(1.39) 

-3.7 

(1.01) 

Japan -2,2 

(1.17) 

10.0 

(2.06) 

4.9 

(1.45) 

-9.4 

(1.53) 

7.4 

(1.13) 

9.1 

(1.07) 

7.2 

(1.29) 

9.7 

(0,94) 

7.8 

(1.19) 

Korea 3.7 

(0.66) 

15.4 

(2.38) 

8.0 

(2.05) 

-2.8 

(0.88) 

20.0 

(1.16) 

17.7 

(1.12) 

7.1 

(1.24) 

22.1 

(1.10) 

21.3 

(1.28) 

Luxembourg -9.0 

(1.88) 

-1.0 

(2.03) 

-12.5 

(1.71) 

-9.4 

(1.15) 

-4.6 

(1.30) 

-2.5 

(1.14) 

-7.6 

(1.24) 

1.0 

(1.24) 

-5.2 

(1.08) 

Mexico -5.1 

(0.97) 

13.0 

(1.07) 

7.3 

(0.74) 

-4.2 

(2.47) 

2.7 

(0.99) 

2.4 

(1.02) 

1.4 

(0.96) 

6.0 

(1,28) 

-1.1 

(1.03) 

Netherlands m 

m 

2.4 

(1.43) 

-8.4 

(1.62) 

-10.0 

(1.55) 

-3.6 

(1.95) 

5.9 

(1.43) 

5.2 

(1.61) 

2.8 

(1.75) 

1.1 

(1,82) 

New Zealand -17.3 

(1.66) 

18.5 

(2.65) 

1,2 

(2.32) 

-14.5 

(1.76) 

11.0 

(1.46) 

-2.9 

(l.SS) 

5.7 

(1.48) 

6.9 

(1.82) 

-5.4 

(1.62) 

Norway -10.4 

(2.81) 

8.0 

(2.26) 

-9.8 

(1.91) 

-25.8 

(2.49) 

14.5 

(1.58) 

8.0 

(1.47) 

21.8 

(1.55) 

18.5 

(1.44) 

1.0 

(1,56) 

Poland -5.9 

(1.32) 

8.4 

(1.18) 

-6.4 

(0,92) 

-lO.O 

(1.22) 

4.3 

(1.88) 

7.4 

(1.84) 

-3.7 

(1.87) 

12.3 

(1.91) 

-5.0 

(1.65) 

Portugal -3.4 

(1.27) 

7.7 

(2.02) 

1.3 

(1.77) 

-3.6 

(0.85) 

12.3 

(1.53) 

10.6 

(1.61) 

-2.3 

(1.71) 

5.4 

(1.29) 

2.3 

(1.87) 

Slovak Republic -3.7 

(1.58) 

-1,9 

(1.52) 

-5.5 

(1.15) 

-2.0 

(1.26) 

-5.2 

(1.49) 

4.5 

(1.58) 

-6.7 

(1,47) 

9.1 

(1,36) 

• 11.3 

(1.49) 

Spain -3.9 

(0.95) 

15.0 

(1.87) 

3,0 

(1.65) 

-7.2 

(0.88) 

11.5 

(1.13) 

11.4 

(1,06) 

6.8 

(1.23) 

11.5 

(1.08) 

6,9 

(1.18) 

Sweden -12.4 

(4.22) 

4.6 

(2.71) 

-25.8 

(2.94) 

-22.2 

(2.56) 

0.2 

(1.86) 

9.9 

(2.03) 

14.4 

(1.82) 

16.5 

(1.89) 

4.3 

(2.00) 

Sw itzerland -8.3 

(3.37) 

-6.3 

(2.49) 

-19.9 

(2.38) 

-12.9 

(1.71) 

-3.0 

(1.50) 

-0.1 

(1.44) 

-11. 1 

(1.38) 

-3.1 

(1.84) 

-4.0 

(1.16) 

Turkey 3.0 

(0,98) 

5.1 

(1.46) 

2,1 

(1.35) 

-6.4 

(1.68) 

8.9 

(1.43) 

4.3 

(1,17) 

3.2 

(1.47) 

10.9 

(1.27) 

2.4 

(1.04) 

United States -13.3 

(2.49) 

18.1 

(1.89) 

4.6 

(1.19) 

-14.6 

(1.16) 

5.5 

(1.32) 

-1.0 

(1.25) 

3.1 

(1.31) 

8.4 

(1.33) 

-3.8 

(1.17) 

Partners 


















Brazil -3.9 

(0,98) 

7.8 

(1.58) 

0,2 

(1.52) 

-15.7 

(1.25) 

0,6 

(1.59) 

-1.0 

(1,38) 

-7.3 

(1.91) 

-3,5 

(1.87) 

-3.3 

(1.65) 

Hong Kong-China -0.6 

(0,88) 

11.7 

(1.17) 

7.2 

(1.19) 

-6.4 

(1.04) 

14.9 

(1.45) 

14.8 

(1.45) 

3.7 

(1.51) 

13.1 

(1.47| 

12.9 

(1.55) 

Indonesia m 

m 

m 

m 

m 

m 

N/A 

m 

m 

m 

ni 

m 

m 

m 

m 

m 

m 

m 

Latvia -2.9 

(1.84) 

1,4 

(1.30) 

-6.0 

(1.58) 

-9.9 

(1.19) 

-6.1 

(2.74) 

6.3 

(3,34) 

-1.3 

(3,09) 

13.2 

(2.23) 

-5.3 

(2,44) 

Liechtenstein c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

Macao- China -7.8 

(2.23) 

13.0 

(3.27) 

5.3 

(2.07) 

-15.3 

(2.83) 

4.5 

(4.07) 

14.6 

(3.92) 

-12.1 

(4,12) 

9.0 

(4.32) 

S.3 

(3.93) 

Russian Fed. -0.6 

(1.07) 

3.5 

(1.00) 

-1.8 

(0,86) 

-9.2 

(1.23) 

-2,0 

(1.37) 

4.1 

(1.65) 

-0.6 

(1.27) 

13.3 

(1.45) 

4.7 

(1,46) 

Serbia -9.3 

(2.02) 

3.1 

(1.49) 

0,5 

(1.23) 

-6.3 

(1.04) 

-4.1 

(1.02) 

-2.5 

(1.49) 

-12.4 

(1.53) 

•2.4 

(1.38) 

-5.1 

(1.28) 

Thailand -0.6 

(0.96) 

16.9 

(1.31i 

10.0 

(0,93) 

-4.9 

(1.01) 

6.1 

(1.34) 

5.1 

(1.55) 

-0.3 

(1.66) 

2.7 

(1.79) 

4.8 

(1.69) 

Tunisia 0.7 

(0.58) 

6.8 

(1.68) 

5.2 

(1.33) 

N/A 

m 

7.0 

(1.02) 

7.8 

(0,91) 

5.9 

(0.92) 

8.9 

(1.18) 

3.6 

(1.00) 

Uruguay -7.4 

(1,50) 

5,4 

(1.50) 

0,7 

(1.42) 

-14.2 

11.57) 

-0.7 

(1.50) 

3.7 

(1.45) 

-1.6 

(1.49) 

-1.0 

(1.73) 

-7.9 

(1.34) 

United Kingdom 0.7 

(1.44) 

19.6 

(1.72) 

-3.1 

(1.54) 

-8.3 

(1.43) 

9.2 

(1.74) 

-1.7 

(1.75) 

10.3 

(1.64) 

5.7 

(1,90) 

-1,4 

(1,50) 


1 . Response rate too low to ensure comparability. 
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Annex C, Bivgfigte gnd Multilevel motlels 


Annex C. Bivgi-Ute gn4 Multilevel 


0 

E 


Table C.3 

Variance explained by the multivariate multilevel model on teaching and learning strategies 


Variance explained 


Between schools 

Witliin schools 

OECD 



Australia 

0.81 

0.38 

Austria 

0.78 

0.31 

Belgium 

0.77 

0.29 

Canada 

0.70 

0.41 

Czech Republic 

0.79 

0.34 

Denmark 

0.75 

0.44 

Finland 

0.50 

0.47 

France 

w 

w 

Germany 

0.84 

0.35 

Greece 

0.73 

0.27 

Hungary 

0.82 

0.27 

Iceland 

0.56 

0.42 

Ireland 

0.87 

0.40 

Italy 

0.64 

0.26 

japan 

0.83 

0.22 

Korea 

0.80 

0.29 

Luxembourg 

0.92 

0.30 

Mexico 

0.64 

0.22 

Netherlands 

0.80 

0.27 

New Zealand 

0.85 

0.44 

Norway 

0.64 

0.48 

Poland 

0.83 

0.47 

Portugal 

0.85 

0.36 

Sloyak Republic 

0.80 

0.39 

Spain 

0.66 

0.32 

Sweden 

0.72 

0.49 

Switzerland 

0.75 

0.37 

Turkey 

0.68 

0.22 

United States 

0.84 

0.42 

Partners 



Brazil 

0.77 

0.24 

Hong Kong-China 

0.77 

0.27 

Indonesia 

m 

m 

Latvia 

0.68 

0.37 

Liechtenstein 

c 

c 

Macao-China 

0.71 

0.31 

Russian Federation 

0.56 

0.30 

Serbia 

0.81 

0.26 

Thailand 

0.64 

0.19 

Tunisia 

0.74 

0.17 

Uruguay 

0.83 

0.25 

Linked Kingdom 

0.82 

0.44 


I . Response rate too low to ensure comparabilitv. 
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Table C.4 

Variance explained by model changes 





Model 1 

Model 2 

Model 3 

Model 4 


Variance in 

Parents’ highest 
occupational status, 
parents’ highest level 

Students’ attitudes 
towards school and 

Students’ interest 
in and enjoyment 
of mathematics and 
.students’ instrumental 

Students’ 


mathematics 

of education, number 

students’ 

sense of 

motivation in 

learning 

anxiety in 


performance 

of books in 

the home 

belonging at school 

mathematics 

mathematics 


Between 

Within 

Between 

Within 

Between 

Within 

Between 

Within 

Between 

Within 


schools 

schools 

schools 

schools 

schools 

schools 

schools 

schools 

schools 

schools 

OECD 











Australia 

1927 

7127 

0,39 

0.07 

0.41 

0,08 

0,41 

0,11 

0,46 

0,19 

Austria 

5250 

4265 

0.22 

0.04 

0.22 

0.05 

0.22 

0.07 

0.26 

0.17 

Belgium 

7240 

5691 

0.22 

0,06 

0.22 

0,07 

0,22 

0.11 

0.23 

0.15 

Canada 

1270 

6210 

0,30 

0,08 

0,31 

0.08 

0,30 

0.15 

0,35 

0.24 

Czech Republic 

4942 

4662 

0.27 

0.06 

0.27 

0.06 

0.28 

0.11 

0.35 

0.20 

Denmark 

1147 

7260 

0,52 

0.11 

0,53 

0,11 

0,51 

0.20 

0.57 

0.33 

Finland 

343 

6659 

0,19 

0,13 

0.23 

0,14 

0.25 

0.23 

0.29 

0.33 

France 

w 

w 

w 

w 

w 

w 

w 

w 

w 

w 

Germany 

6101 

4473 

0,27 

0,06 

0.27 

0.06 

0,25 

0.12 

0,31 

0,20 

Greece 

3357 

5869 

0,25 

0,04 

0,26 

0,04 

0,25 

0,10 

0.28 

0.15 

Hungary 

5710 

4068 

0.28 

0.03 

0.28 

0.04 

0.25 

0.08 

0.30 

0.14 

Iceland 

319 

7842 

0.36 

0.08 

0,40 

0,11 

0,36 

0.16 

0,40 

0.24 

Ireland 

1218 

6124 

0,56 

0,09 

0.57 

0,10 

0,56 

0.14 

0.62 

0.21 

Italy 

4915 

4463 

0.13 

0.02 

0.13 

0.02 

0.12 

0.06 

0.17 

0.12 

Japan 

5400 

4757 

0.07 

0.02 

0,07 

0,02 

0.13 

0,07 

0.10 

0.08 

Korea 

3607 

5006 

0,27 

0,07 

0.27 

0,07 

0,41 

0,15 

0,40 

0.16 

Luxembourg 

2673 

5841 

0.35 

0.06 

0.36 

0.06 

0.34 

0,08 

0,40 

0.14 

Mexico 

2496 

3872 

0,09 

0.00 

0,16 

0.03 

0.12 

0.04 

0.20 

0.11 

Netherlands 

5508 

3345 

0.18 

0.05 

0,18 

0,05 

0,16 

0.11 

0,18 

0.16 

New Zealand 

1781 

7956 

0.46 

0.11 

0,47 

0.13 

0.41 

0.15 

0.58 

0.27 

Norway 

578 

7898 

0,39 

0.13 

0,43 

0.15 

0.52 

0.26 

0.57 

0.35 

Poland 

1035 

7139 

0,62 

0,13 

0,62 

0,14 

0.61 

0.18 

0,66 

0.33 

Portugal 

2620 

5167 

0.36 

0.11 

0.39 

0.12 

0.38 

0.15 

0.41 

0.20 

Slovak Republic 

3794 

5003 

0.36 

0.08 

0,37 

0.09 

0.34 

0.13 

0.38 

0.25 

Spain 

1489 

6050 

0,41 

0.10 

0.41 

0,10 

0.41 

0.16 

0.44 

0,19 

Sweden 

970 

8026 

0,48 

0,14 

0.50 

0,16 

0,47 

0.22 

0.57 

0,32 

Switzerland 

3165 

6114 

0.28 

0.10 

0.29 

0,10 

0,27 

0.14 

0.32 

0,21 

Turkey 

5915 

4864 

0.18 

0.03 

0.19 

0,04 

0,19 

0,07 

0,24 

0.11 

United States 

2345 

6754 

0,46 

0,12 

0.46 

0,12 

0,40 

0,16 

0.52 

0.25 

OECD average 

3069 

5822 

0.32 

0.08 

0.34 

0.08 

0.33 

0.13 

0.38 

0.21 

Partners 











Brazil 

4159 

5180 

0.18 

0.02 

0.18 

0.02 

0.16 

0.03 

0.28 

0.10 

Hong Kong-China 

4573 

5226 

0,09 

0.02 

0.10 

0,03 

0.17 

0,10 

0.20 

0.12 

Indonesia 

m 

m 

ra 

m 

m 

m 

m 

m 

m 

m 

Latvia 

1761 

6059 

0,29 

0.07 

0.30 

0,08 

0,30 

0,11 

0.41 

0,23 

Liechtenstein 

c 

c 

c 

c 

c 

c 

c 

c 


c 

Macao-China 

1455 

6404 

0.08 

0.00 

0.10 

0,01 

0,14 

0,06 

0,16 

0.12 

Russian Fed, 

2558 

5951 

0.22 

0.05 

0.22 

0,06 

0.22 

0.07 

0.29 

0.17 

Serbia 

2566 

4681 

0.25 

0.03 

0.25 

0.03 

0.23 

0.04 

0.37 

0.13 

Thailand 

2602 

4394 

0.21 

0.01 

0,22 

0.02 

0,22 

0,03 

0.22 

0,04 

Tunisia 

2807 

3882 

0.21 

0.03 

0.23 

0.04 

0.23 

0.06 

0.24 

0.07 

Uruguay 

4618 

5899 

0.25 

0,03 

0.25 

0.03 

0,23 

0,07 

0,31 

0.12 

United Kingdom 

1892 

6322 

0,47 

0,11 

0.47 

0.12 

0.46 

0.14 

0.51 

0.22 


1 . Response rate too low to ensure comparability. 
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Annex C. Bivgi-Ute gn4 Multilevel 


Table C.4 

Variance explained by model changes (continued) 



Model S 

Model 6 

Model 7 

Model 8 

Model 9 


Students’ self-efficacy 
in mathematics and 

Hours per week of 
total homework, 
hours per week 
of mathematics 
homework, tutoring 

Memorisation/ 
rehearsal strategies, 

Preference for 
competitive learning 
situtations, preference 

Teacher 

support, 


students’ sell 

concept 

in mathematics, 

elaboration strategies. 

for co-< 

perative 

student- teacher 


in mathematics 

out-of-school classes 

control strategies 

learning situtations 

relations 


Between 

Within 

Between 

Within 

Between 

Within 

Between 

Within 

Between 

Within 


schools 

schools 

schools 

schools 

schools 

schools 

schools 

schools 

schools 

schools 

OECD 











Australia 

0.S7 

0.32 

0.61 

0.34 

0.65 

0.37 

0.65 

0.37 

0.67 

0.38 

Austria 

0.40 

0.26 

0.44 

0.29 

0.47 

0.31 

0.47 

0.31 

0.49 

0.31 

Belgium 

0.31 

0.24 

0,39 

0,26 

0,43 

0.28 

0.43 

0.28 

0,46 

0,29 

Canada 

0.50 

0.37 

0.52 

0.39 

0.56 

0.40 

0.56 

0.40 

0.57 

0.41 

Czech Republic 

0.49 

0.30 

0.53 

0.32 

0.55 

0.33 

0.55 

0.33 

0.57 

0.34 

Denmark 

0.62 

0.40 

0,65 

0.42 

0.67 

0.44 

0,66 

0.44 

0.68 

0,44 

Finland 

0,43 

0.43 

0.44 

0.45 

0.46 

0.46 

0.46 

0.46 

0.48 

0.47 

France 

w 

w 

w 

w 

w 

w 

w 

w 

w 

w 

Germany 

0,42 

0,29 

0,48 

0.33 

0,51 

0.34 

0,51 

0,34 

0,53 

0.35 

Greece 

0.40 

0.21 

0.46 

0.25 

0.48 

0,27 

0.48 

0.27 

0.49 

0.27 

Hungary 

0.45 

0.23 

0.50 

0.26 

0.51 

0.27 

0.52 

0.27 

0.53 

0.27 

Iceland 

0.35 

0.35 

0.45 

0.39 

0.52 

0,42 

0.53 

0.42 

0,54 

0.42 

Ireland 

0.76 

0.33 

0.77 

0.36 

0.79 

0.38 

0.79 

0.38 

0.79 

0.40 

Italy 

0.30 

0.22 

0.32 

0.25 

0.35 

0.26 

0.35 

0.26 

0.39 

0.26 

Japan 

0.37 

0,17 

0,45 

0.21 

0,46 

0,22 

0.46 

0.22 

0.50 

0.22 

Korea 

0.56 

0.24 

0.59 

0.28 

0,60 

0,29 

0,60 

0.29 

0,61 

0.29 

Luxembourg 

0.51 

0.24 

0.54 

0.27 

0.57 

0.29 

0.57 

0.29 

0.60 

0.30 

Mexico 

0,29 

0.17 

0.36 

0.19 

0,36 

0,20 

0,36 

0.20 

0,39 

0.22 

Netherlands 

0.27 

0.24 

0.36 

0.26 

0.37 

0.26 

0.37 

0.26 

0.38 

0.27 

New Zealand 

0.61 

0.37 

0.68 

0.41 

0.73 

0.43 

0.73 

0.44 

0.75 

0.44 

Norway 

0.59 

0.43 

0,61 

0,46 

0,61 

0.47 

0.61 

0.47 

0.62 

0,48 

Poland 

0.74 

0.42 

0,75 

0,44 

0,76 

0,46 

0.76 

0,46 

0,78 

0.46 

Portugal 

0.55 

0.30 

0.59 

0.33 

0.61 

0.35 

0.62 

0.35 

0.66 

0.36 

Slovak Republic 

0,55 

0.36 

0,57 

0,37 

0,59 

0,38 

0,58 

0,38 

0,61 

0.39 

Spain 

0,49 

0.27 

0.52 

0,31 

0,54 

0.31 

0,54 

0,31 

0.57 

0.32 

Sweden 

0.60 

0.43 

0.66 

0.47 

0.67 

0,48 

0.67 

0.48 

0.66 

0.49 

Switzerland 

0,52 

0,30 

0.55 

0,33 

0,59 

0.35 

0.60 

0,35 

0.63 

0,36 

Turkey 

0.37 

0.17 

0.40 

0,19 

0.41 

0,20 

0.41 

0.20 

0.44 

0.22 

United States 

0.60 

0.35 

0.71 

0.39 

0.74 

0.41 

0.74 

0.41 

0.76 

0.42 

OECD average 

0.49 

0.30 

0.54 

0.33 

0.56 

0.35 

0.56 

0.35 

0.58 

0.35 

Partners 











Brazil 

0.39 

0.15 

0.55 

0.23 

0.57 

0.23 

0.57 

0.24 

0.58 

0.24 

Hong Kong-China 

0.39 

0.22 

0,46 

0,26 

0.48 

0.27 

0,48 

0,27 

0.49 

0.27 

Indonesia 

m 

m 

m 

m 

m 

m 

m 

m 

m 

m 

Latvia 

0,49 

0.33 

0.51 

0.35 

0.52 

0,36 

0.52 

0.36 

0.55 

0.37 

Liechtenstein 

c 

c 

c 

c 

c 

c 

c 

c 


c 

Macao-China 

0.39 

0.21 

0.54 

0.27 

0.55 

0,29 

0,55 

0.29 

0.57 

0.30 

Russian Fed. 

0.35 

0.24 

0.37 

0.27 

0.39 

0.28 

0.39 

0.28 

0.43 

0.30 

Serbia 

0.47 

0.20 

0.48 

0.22 

0,51 

0.24 

0.51 

0.24 

0.58 

0.26 

Thailand 

0.28 

0.09 

0.33 

0.14 

0.34 

0.15 

0.35 

0.15 

0.37 

0.19 

Tunisia 

0.35 

0.12 

0.41 

0.15 

0.41 

0.15 

0.42 

0.15 

0.47 

0.17 

Uruguay 

0.40 

0.18 

0.48 

0.23 

0.50 

0,24 

0.51 

0.24 

0.55 

0.25 

United Kingdom 

0.64 

0.35 

0.68 

0.40 

0.71 

0.42 

0.71 

0.42 

0.73 

0.44 


1 . Response rate too low to ensure comparability. 
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Table C.4 

Variance explained by model changes (continued) 



Model 10 

Model 1 1 

Model 12 


School average of the 
highest international 
socio-economic index 
of occupational status 
(HISEI) between both 
parents 

School 

size 

Disciplinary 
and school 
disciplinary 

climate 

average 

climate 


Between 

Within 

Between 

Within 

Between 

Within 


schools 

schools 

schools 

schools 

schools 

schools 

OECD 







Australia 

0,81 

0,38 

0,81 

0.38 

0.81 

0.38 

Austria 

0.72 

0.31 

0.75 

0.31 

0.78 

0.31 

Belgium 

0,70 

0,29 

0,70 

0,29 

0,77 

0.29 

Canada 

0.67 

0,41 

0.69 

0.41 

0.70 

0.41 

Czech Republic 

0.77 

0.33 

0.77 

0.33 

0.79 

0.34 

Denmark 

0.72 

0.44 

0.73 

0.44 

0,75 

0,44 

Finland 

0,48 

0,47 

0,50 

0.47 

0.50 

0.47 

France 

w 

w 

w 

w 

w 

w 

Germany 

0,80 

0.35 

0.80 

0,35 

0,84 

0.35 

Greece 

0,71 

0,27 

0.72 

0.27 

0,73 

0.27 

Hungary 

0.79 

0.27 

0.80 

0.27 

0.82 

0.27 

Iceland 

0,54 

0.42 

0,56 

0,42 

0.56 

0,42 

Ireland 

0.86 

0,40 

0,87 

0.40 

0.87 

0.40 

Italy 

0.63 

0.26 

0.63 

0.26 

0.64 

0.26 

Japan 

0.73 

0,22 

0.73 

0.22 

0.83 

0,22 

Korea 

0.75 

0,29 

0,76 

0.29 

0.80 

0.29 

Luxembourg 

0.91 

0.30 

0.91 

0.30 

0.92 

0.30 

Mexico 

0.59 

0,22 

0.61 

0.22 

0.64 

0,22 

Netherlands 

0.75 

0.26 

0.78 

0.27 

0.80 

0.27 

New Zealand 

0.84 

0.44 

0.85 

0.44 

0.85 

0.44 

Norway 

0.63 

0.48 

0.63 

0,48 

0,64 

0,48 

Poland 

0.82 

0,47 

0.82 

0,47 

0,83 

0,47 

Portugal 

0.75 

0.36 

0.78 

0.36 

0.85 

0.36 

SloA’ak Republic 

0,78 

0.39 

0.78 

0,39 

0.80 

0.39 

Spain 

0,65 

0,32 

0,65 

0,32 

0.66 

0,32 

Sweden 

0.69 

0,49 

0.71 

0.49 

0.72 

0.49 

Switzerland 

0.72 

0.37 

0.72 

0,37 

0,75 

0.37 

Turkey 

0.61 

0,22 

0.61 

0,22 

0.68 

0,22 

United States 

0.82 

0.42 

0.82 

0,42 

0.84 

0.42 

OECD average 

0.73 

0.3S 

0.7i 

0.35 

0.76 

0.36 

Partners 







Brazil 

0.75 

0.24 

0.75 

0.24 

0.77 

0.24 

Hong Knng-China 

0.60 

0,27 

0.72 

0.27 

0,77 

0,27 

Indonesia 

m 

m 

m 

m 

m 

m 

Latvia 

0.62 

0.37 

0,67 

0,37 

0.68 

0.37 

Liechtenstein 

c 

c 

c 

c 

c 

c 

Macao-China 

0,63 

0,30 

0.69 

0.30 

0.71 

0,31 

Russian Fed. 

0.52 

0,30 

0.52 

0.30 

0.56 

0.30 

Serbia 

0.76 

0.26 

0.76 

0.26 

0.81 

0.26 

Thailand 

0.62 

0,19 

0,64 

0.19 

0,64 

0,19 

Tunisia 

0.70 

0.17 

0.71 

0.17 

0.74 

0.17 

Uruguay 

0.78 

0.25 

0.79 

0.25 

0.83 

0,25 

United Kingdom’ 

0,80 

0,44 

0.81 

0.44 

0.82 

0.44 


1 . Response rate too low to ensure comparability. 
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Annex C, Bivgfigte gnd Multilevel motlels 


Annex C. Bivgi-Ute gn4 Multilevel 



Table C. 5 

^ Effect of mathematics achievement of learning strategies controlling for self-efficacy 

0 

E 

Dependent Variable; Student mathematics achievement 


Memorisation Elaboration Control strategies Mathematics self- 

(Constant) strategies (WLE) strategies (WLE) (WLE) efficacy (WLE) 



B 

S.E. 

B 

S.E, 

B 

S.E, 

B 

S.E, 

S.E. 

B 

OECD 











Australia 

519.61 

0.18 

-0.82 

0,26 

-19.92 

0,24 

5.47 

0,26 

48.41 

0.19 

Austria 

498.06 

0,33 

-14.68 

0.30 

-9.17 

0,27 

1.95 

0.29 

43.17 

0,29 

Belgium 

532.99 

0.29 

-4.07 

0.38 

-16.08 

0.34 

-2.93 

0.38 

44.10 

0.31 

Canada 

523.79 

0,15 

-3.72 

0,19 

-9.U 

0.18 

4.05 

0.19 

41.76 

0,15 

Czech Republic 

511.60 

0,24 

-14.83 

0.32 

-2.00 

0.36 

-0,57 

0,35 

50.96 

0,27 

Denmark 

515.31 

0.40 

-3.78 

0.52 

-6.42 

0.56 

-8.72 

0.57 

53.28 

0.43 

Finland 

545.53 

0,39 

-2.90 

0,44 

-2.16 

0,49 

-2.99 

0,55 

44.19 

0.38 

France 

510.29 

0,10 

-6.40 

0,12 

-12.62 

0.11 

3.23 

0,12 

46.30 

0,11 

Germany 

501.39 

0.11 

-14.89 

0.09 

-8.09 

0,09 

0.22 

0.10 

47.27 

0,09 

Greece 

465.65 

0.32 

-12.05 

0.37 

-2.34 

0.37 

2.89 

0.37 

41.90 

0.34 

Hungary 

472.99 

0,28 

-6.34 

0,35 

-11.50 

0,34 

-5.08 

0,37 

50.03 

0,27 

Iceland 

511.59 

1.31 

-4.39 

1.66 

-11.20 

1,68 

-2.70 

1.77 

42.23 

1.25 

Ireland 

503.07 

0.34 

-2.65 

0.45 

-12.58 

0.43 

-3.36 

0.46 

47.31 

0.37 

Italy 

475.50 

0,13 

-11.59 

0.17 

-14.79 

0.16 

2.33 

0,17 

51.93 

0.16 

Japan 

553.74 

0.10 

-2.74 

0.10 

-5.51 

0.09 

1.92 

0.10 

51.60 

0,08 

Korea 

560.34 

0.12 

-7.11 

0.15 

-3.00 

0.16 

14.82 

0,17 

44.63 

0.14 

Luxembourg 

488.02 

1,35 

-3.47 

1,45 

-13.33 

1,29 

-3.75 

1,49 

41.58 

1,27 

Mexico 

423.19 

0,13 

-2.25 

0,12 

-16.27 

0,13 

7.05 

0,12 

32.25 

0.11 

Netherlands 

538.96 

0.20 

12.24 

0.29 

-18.82 

0.27 

-7.71 

0.28 

43.57 

0,22 

New Zealand 

526.38 

0,39 

-4.15 

0,55 

-25.87 

0,53 

6.79 

0,54 

52.03 

0.42 

Norway 

497.53 

0.37 

9.15 

0.49 

-12.43 

0.48 

-3.02 

0.52 

42.94 

0.38 

Poland 

492.28 

0.12 

-7.77 

0.16 

-5.44 

0.17 

-2.30 

0.17 

49.56 

0.12 

Portugal 

471.55 

0.27 

-11.78 

0.33 

-10.39 

0.36 

10.75 

0,37 

49.55 

0,34 

Slovak Republic 

483.53 

0,33 

-7.65 

0.40 

-7.09 

0.43 

-7.27 

0,43 

52.88 

0,29 

Spain 

490.53 

0.14 

-3.15 

0.20 

-3.67 

0.19 

3.00 

0.20 

40.06 

0.17 

Sweden 

501.07 

0.29 

2.38 

0.34 

-3.22 

0.37 

-16.39 

0,38 

50.86 

0,27 

Switzerland 

507.04 

0,31 

-13.25 

0,31 

-10.55 

0,32 

0,21 

0.33 

50.35 

0,29 

Turkey 

451.73 

0.15 

-9.71 

0.17 

-12.96 

0.17 

8.43 

0.17 

47.06 

0.14 

United States 

478.85 

0.05 

-4.16 

0.07 

-17.85 

0,06 

1.23 

0.07 

48.16 

0.05 

OECD average 

S0I.80 

0.31 

-3.40 

0.37 

-10.30 

0.J7 

0.26 

0.39 

46.55 

0.31 

Partners 











Brazil 

411.48 

0.10 

-18.84 

0.09 

-13.57 

0,09 

6.62 

0.09 

38.06 

0.08 

Hong Konsj-China 

538.72 

0.33 

-12.83 

0.43 

-3.96 

0.44 

12.54 

0.47 

49.81 

0.35 

Indonesia 

391.51 

0,09 

-24.45 

0.08 

5.02 

0.11 

9.01 

0.09 

18.51 

0.11 

Latvia 

486.71 

0.51 

-4.74 

0,73 

-3.28 

0,74 

-12.25 

0,72 

51.02 

0.58 

Liechtenstein 

499.15 

4.91 

-23.04 

4.37 

-8,59 

4.76 

-3.63 

4.49 

46.62 

4,39 

Macao-China 

520.95 

1.07 

-14.45 

1.28 

-0,29 

1.43 

5.00 

1.49 

34.94 

1.35 

Russian Fed. 

476.41 

0,06 

-5.53 

0,10 

-7.69 

0.10 

-631 

0.09 

48.55 

0,08 

Serbia 

451.32 

0,39 

-14.29 

0.41 

-3.41 

0,41 

-0.36 

0,36 

31.97 

0.37 

Thailand 

450.02 

0.19 

-16.02 

0.20 

0.76 

0.22 

6.22 

0.20 

32.16 

0.14 

Tunisia 

385.99 

0,33 

-2.33 

0.24 

-0.32 

0.29 

1.33 

0,26 

25.90 

0,25 

Uruguay 

441.48 

0,54 

-6.00 

0,60 

-9.64 

0,65 

-3.97 

0.67 

41.73 

0.58 

United Kingdom' 

514,63 

0.10 

2,93 

0,14 

-23,29 

0,14 

-1.30 

0,15 

51.87 

0.11 


1 . Response rate too low to ensure comparability. 
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